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PREFACE > . 

• • t . . ' : 

The VR Program^ Standards Evaluation System was developed in response 
to evaluation requirements in the 1973 Rehabilitation Act. It has been 
desigrted with a 'focus-on VR service outcomes, and on key procedural issues. 
The system includes procedures for usi,ng standards data to monitor and 
evaluate program performance, and to assist program managers in directing 
their programs toward improved performance. During the last two years-, 
the system of , standards has been pretested in six Model Evaluation Unit 
states. As a res.ult of the pretest, fJhal revisions have been made to tke . 
Program Standards System. The refined system contains eigh€ Performance 
Standards and associated data elements, and five Procedural Standards. Oxrr 
recommendations for data collection procedures reduce the^requitements for 
client surveys, and ijitegrate new data collection needs into the routine 
dat{i requirements to reduce reporting burden. 

i,The$e Guidance >Iaterials ^e Volume III of our final report on the 
Program Standards System. They contain an overview of the Program Stan- 
dards System, and descriptions of the standards, data elements, and data 
collection forms. Instructions for collecting the data are included, as 
is a description of the Standards Reports which will be generated by the 
USA Management Information System (MIS) . Volme I of our final report 
presents the Results of the Program Standards Pretest ^ from which final 
recommend§tions for the Standards System were developed. Volume II covers 
the Analytic Paradigm , which, desclribes the management tises of the systc^te. 
* Volume IV. is Training Materials/ for users of the system. 

Berkeley Planning Associates would like to thank the Model Evaluation 
Units for their participation in the pretest. We would also like to thank 
the San Diego State University RCEP IX for serving in its role in training 
and data analysis for the' Procedural Standards pretest. Finally, we would 
like to thank the University of Michigan"* RRI , ^Abt Associates, and all RSA 
reviewers for their input into our project efforts. 
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I . INTRODUCTION 



THe 1973 Rehabilitation Act contained, among its many other provisions'', 
a rlqiiirement that evaluation standards be jdevised 'and implemented to Mea- 
sure the performance of the VR program in achieving its mandate, ^nce 
* 1974, state VR agencies have provided RSA with data on their clients, on 
the services provided to clients, and on varioios aspects of agency organi- 
zation and operation. RSA, in txim,^ has losed this data to generate "Stan- 
dards Reports," which detail each state agency's level of performance oh 
the varioTis measures inclucied in the standards, arid which provide compara- 
tive information on state agencies '.performance in relation to. national 
norms • 

Beginning ^ih 1976, RSA undertook ^ new developmental effort to revise 
the VR Program Standards. The steps in that process included: 

• a two-year contract, awarded to Berkeley Planning Associates 
(BPA) , to develop a revised set of Program Standards and 
data collection instruments; and *' 

• a three-year pretest of the revised Program Standards, 

conducted in six* state agency Model Evaluation Units * 

(MEUs),^ and designed to test the validity, feasibility, 

' ,and informational utility ^f' the revised stand^ds. 
i 

The pretest culminated in a final set of recommendations fox the 
revise^ Rrogram Standards. This report is intended to provide guidance 
to state agency and RSA federal and regional personnel in understanding 
and implementing the Program Standards system. To provide the necessary 
guidance, this report disctisses a wide variety of topics. First, we pre- 
sent a brief, .overall description of the purposes and struqture of the 
Program Standards system. Following this, we present detailed discussions 
of the various components of the system. Chapter II deals with the 



^The si-bc MEl/s were: the Michigan General Agency; the Pennsylvania, 
Oregon, Delaware, and Virginia Combined. Agencies; and the Mississippi Blind 
Agency. 
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^'Performance St^dards/' These consist of eight goal-statements (i.e., 
"standards'*) > and the data elements used to measure achievement of those 
goals. The Performance Standards provide information to. answer questions 
concerning a state agency's achievements, in terms of: , . 

• Coverage ; For example, is the ageilcy adequately 
addressing the scope and type of needs of its eligible 
target populations? ' 

• Efficiency ; Is the agency sufficiently productive, given 
the resources available to it? 

• Impact : Does the agency help to improve the quality of 
life of the individual clients it serves? Does the agency 
Vetum more benefits to society (in terras of wages, taxes, 
and other benefits) than the societal costs it incurs (e.g., 

• tax revenues expended)? 

Chapter II discusses each of the eight Performance Standards and data 
elements with respect to the rationale for including the standard or data 
element in the Performance Standards; and wit^ respect to the form, data 
sources, and method of computing each of the data elements. As welL, 
Chapter II discusses the data collection requirements for implementing 
the Performance Standards. Here, we present examples of the data col- 
lection forms, and instructions for their implementation. 

In Chapter III we turn to the ['Procedural Standards Tliese are a 
set of five goal-statements pertaining to issues of compliance, data 
valiclity, and case handling. The Procedural Standards are addressed via 
a case review procedure. As with the Performance Standards, in Chapter 
III we discuss the rationale for each of the Procedural Standards, and 
present the data collection forms and instructions for their implementation. 

Finally, in Chapter IV we discuss the reporting system which will 
be implemented as part of the overall Program Standards system. This 
chapter illustrates the specific data items which will be produced by the' 
reporting system, and illustrates how the data items will be juxtaposed 
by the reporting system to facilitate analysis and interpretation of the 
standards data. 

When fully implemented, the revised Program Standards system will 




first order of business, then, is* to provide the reader with a "broad 
understanding of the r^vis^d VR Program Standards system. Below, we 
provide a brief disciission of the purposes and structure of the overall 
system. 



PURPOSES OF»THE PROGRAM STANDARDS SYSTEM ^ ' 

The purposes of the program standards system, simply put, are: 

• to make available information on the achievement of the state 
VR agencies with respect to the goals and functions of the 

VR system, as .measured by the standards data elements; and, 
more importantly, 

• to identify possible problems and corrective actions, when- 
-ever state VR agencies are un^bl^ to reach their objectives 
for achievement; and thu3 

• to gxiide the behavior of state VR agencies towards greater 
achievement. 

Providing Information - . 

The revised standards system thxis shares with the current standards 
system the purpose of providing information to RSA, to the state /R agen- 
cies, and to other interested parties such as 0MB. and Congress on the 
iachievement of state VR' agencies. InformatioiTwill be provided on the VR 
program as a whole/ and on each 'state VR agency. ^ Information will be 
provided on current achievement, as well on past achievement. Moreover, 
other information relevant to the VR program will be provided as part of 
the revised standards system. . " 

Identification of Problems- and of^ Corrective Actions 

One o£ the unique features of the revised standards system' is that - 
it dod^ not stop when a state VR ageiicy does not meet its objective on a 
particular standard data element. Instead, a newly^-developed data-based 
" ^decision support system identifies possible problems and corrective actions. 
This system is designed to enable program managers to quickly identify whether 
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possibler problem^ 4an be identified or whether 'fur^er investigative 
' research is 'requii'ed. . . " 

Guiding the Behavior of the State VR Agencies ' • - 
Z ^ ^ — » ^ . 

^ -^ Another unique feature of the revised standards system is tha^ it i^ 
oriented to guiding and. changing the behavior pf the state VR agencies in 
• new directions, not just reporj^ing pn p|st behavior. It -is prospective, 
not retrospective, Whereas ithe current standards system calculates per- 
formance noOTs bksed on central tendency measures for the nation as a* whol 
the' revised standards system is designed to allow setting of future per- - 
formince goals ,^^asb< on the individual state, -In the revised system,, 
each statQ (l)'Set^ its own. objectives under *the standards* for evaliiative 
comparison; and (2) has the option of deciding ^••hich other "^state .programs, 
if any, sjjtould. provide appr6pi*iate comparisons for assessing the state's, 
performance. State agencies can consider such things as past state pro- 
gram pe/formance, state need and available resources, and state-^et . 
policies 'when 'setting their performance goals. 

In short, the revised standards system replaces a federally-directive 
set of "after the fact" norms with future-oriented goals set by the indi- 
vidual state program. By-setting goals in advance, the VR system can be' 
guided in the directions that the states* and RS . vk^t the system to go. 
The overall direction of the VR program thtis can be changed-; >as can the 
achievement of particular state VR agencies. 

However, it should be noted that no sanctions are buiit into the 
Program St^dards system., That is, nb punitive actions are tied to the 
failure of a state VR agency to meet its objectives. Funding decisions 
are also not based on achievement of the objectives. Instead, the revised 
standards system is concerned with flagging problematic attainment, 
investigating possible prc^lems, and* identifying and taking corrective 
actions. ' > * * . ' 

In sum, the focus of the new standards system is state agency manage- 
ment improvement and evaluation capacity. The federal role is proposed 
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as. one of n^cpssary data provision, the generation and making' available 
o*£ comparison data as appropriate, and the provision of technical assis- 
tance to the state agency for interpreting standards data and identifying 
hbw# to ^improve program performance.. The leadership role in improving 
state performance is JiAsigned to -the iildividual state a^ency'\under the 



yevised standards system. 

STRUCTURE 'PF THE 'PROGRAM STANDARDS SYSTEM 



* ' The Program Standards system jias several. components,^ as shown in 
^Figure 1: * 

• Standards and Data Elements . A set of eight Performance / 
Standards and five Procedural Standards < with associated 
data elements, measures the goals and functions of the VR 
program with respect to Coverage, cost-effectiveness^ impact ^ 
of client services, compliance, data quality, and the process 
of serv^.ce- delivery. ^ _ * 

t Process for Set ting .Performaike Objectives . A procbss for . 

setting objectives each state VR agency on each of the 

standards data Elements provides clear 'expectations for 

achievement, expectations that are set in conjunction with 

'each agency. . . ' \ 

Y ' ' - 

• ' Reporting System ^ A reporting system presents the levels 

of achievement of state VR agencies on the measjores of the 
/ joals and functions of the VR system which' are captured in 
tlie standards data elements. The system also identifies 
those state VR ^agencies with difficulties in achieving 
their perfoiaaance expectations. Background information 
on past achievement, the achievement of other state VR 
, agencies, the components of the data elements, .and on 
informational data elements are also presented. 

• Data-Based Decision-Support System . Possible reasons for 
problematic attainment of a- particular stiate VR agency on 
a particular data element are identified*, either through 
investigation by program managers or through further ^ 
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Figure 1 
Thg Program Standards System 
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eva.luation research. In addition, v:oiTective actions 

are identified for each possible problem. . 1^ 

* As, can be seen from Figure 1, all four of these components are 
oriented to the management- of the VR program. * • 

* * 

The Revised Standards and Data Elements 

The new standards, and the decision-sxqjport system underlying them, 
emplmsize objective-setting by state agencies and analysis of data 
whi?P is .sensitive to the staters particular circimistances. The standards 
are, however, firmly grounded in RSA's statement of national goals, specif* 
ically those of coverage, co^t-effectiveness and efficiency, the quality 
and impact of serviced, and cqjnpliance with federal regulations. The ) 
state, agency sets thtf level of performance to be achieved in terms of 
these; broad goals. The new recommended standards and daja elements for 
measuring and monitoring their achievement are shown in Table 1. Reviewed 
individually, t^e standards are as follows: 

• • The fir?£ standard addresses coverage , or the extent to which the 
vocational rehabilitation program is serving the eligible target population. 
The need to ensure accessibility of services to all the eligible disabled 
,is of par? jiount ^important to RSA and the states.^ The first data element 
—clients served per 100,000 population — provides a proxy measure of 
coverage of eligible populatipn. The second measure — percent of clients 
served who are severely disabled — measures achievement of the priority 
legislated for the severely disabled by Congress. 

• The second standard addresses directly the cost-effectivfeness of 
the state program's overall use of resources, and the benefit^cost returns 
from investment in vocational rehabilitation services • The first two data 
elements measure the cost of achieving desirable outcome^, — first, expendi- 
tures per competitively employed closures, and second the expenditure per 

26 closure* The focus on con^etitively employed closures recognizes the 
policy decision in RSA that such a closure is the highest priority in the 
program for clients. The second two data elements focus on the two accepted 
measures of bfenef it-cost returns — the ^benefit-cost ratio and discounted 
present value. The standards use the benefit-cost model developed at 
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Table 1 

VR P^otjrara Standards and Data EWraen^s: Final Recoganendations, 1981 



PERFORMANCE STANDARDS^>^{D DATA ELEMENTS 

1 . Coverage 

VR shal^ serVe theroaximua proportion of the potentially eligible target population, subject 
^ Che. level of federal prograa funding and priorities among clients. 

U) Clients-served per 100,000 population ' 
I'll) • Percent severely disabled served 

V 

2. Cost-Effectivenessand Ben efit^Cost Return ' ^ 
► w — ' 

The V}^ prograa shall use resources in ^ cost-effective Banner and show a positive return to 

' society of investnent in vocational, rehabilitation of disabled clients. 

(i) Expenditures per coiapetitively eoployed closure 

(ii) Expenditure per 26 closure " . * 

(iii) Ratio of total VR benefits to total VR costs (Benefit-cost ratio) 

(iv) Total net benefit^froo VR services (Discounted net present value) 

« 

3. y Rehabilitation Rate • 

VR shall aaxiisize tHe luaber and proportion of clients accepted for services who are 
successfully rehabilitated, subject to the meeting of other standards. 

(i) Percent 26 closures 

(ii) Annpal change in nuober of 26 ^closures 

4. Econoaic TndependePce * ■ ^ 
Rehabilitated clients shall evidence econonic independence. 

(i) Percent 26 closures with weekly earnings at/above fede:cil nininma wage* 

(ii) Con^arison of earnings of conpetitively employed 26 closures to 'earnings of employees 
, , in state ' . • 

o.jaS* * Gainful Actlviry ^ ^ 

There shall be eaximua placement of rehabilitated clients into cospetltive employment. 
Noncompetitive closures shall represent an improvement in gainful activity for the client. 

(i) Percent 26 closi ves competitively eailoyed^ 

(ii) Percent coapetitively employed 26 closures'with hourly baVnings at/above federal 
ninimua wage / « 

(iii) Percent noncrnspetitively employed 26 closures showing improvement in function and 
life status (iapleaertt after FAI/LSI pretest) " • 

6. Client Chanfe * ' • 

Rehabilitated clients shall 'evidence vocational gains. 

(i) Comparison of earnings before and after VR services 

(ii) (In addition, chantes in other statuses, ^d functioning ability, when such measures 
b'ebo^e available) ^ 
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Retention ^ 
Rehabilitated clients shall retain the benefits of VR services. 

(i) Percent 26 closures retaining earnings at follow-up 

(ii) Comparison of 26 closures with public assistance as primary source of support at 
closure and at follow-up 

(lii) Percent noncompetitively employed 26 closures fetaining closure skills at follow-up 
(implement after FAI/LSI pretest) 

Satisfaction 

Clients shall be satisfied with the VR program, and rehabilitated clients :>hall appraise 
VR services^ as useful In achieving and maintaining their vocational objectives. 

) Percent closed qliejits satisfied with overall VR experience y 
i) Percent closed clients satisfied with: counselor, physical restoruriort, 
job training services, placement services | 

(iii) Percent 16 closures judging services received as useful m obtaining their ;ob/ 
homemaker situation or in current performance 
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^*^TabIe I (cont.) 



PROCEDURAL STA.SDARDS 



10. 



a. 



R-500 Validity \ ' ^ 

Information collected on clients by the R-300 and all data reporting syst^s us^ by RSA 
shall be valid, reliable, accurate^ and complete. ^ 0 a ' 

Eliyibility , . ^ 

Eligibility decisions shall be based on accurate and sufficient diagnostic information, 
and VR shall continually review and evaluate eligibility decisions to ensure that 
decisions are being made in accordance with laws 'and' regulations. 

Timeliness 

VR shall ensure that eligibility deci^ons and client movement through the VR process 
occur in a timely manner appr^riate to the needs and capabilities of the clients. 

12. IWRP 

VR shall provide an Individualized Written Rehabilitation Program for each applicable 
client and VR and the client jshall be accountable to each qther for compll^g with this 
^agreement , 

^ . • 

15. Goal Planning 

— ^\ ' ' 

Counselors shall make an effort to-set realistic goals for 'clients. Couprehensive con- 
sideration must be given to all factors in developing appropriate vocati'onal goals such 
that there is a aaxinua of correspondence between goals and outcones: competitive goals 
should have coapetitive outcomes and ffinconpetitive goals should have noncompetitive 
outcomes. 
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* Berkele)f andr*used over the ye^s by RSA and many state agencies for reports 
to Congress and state legislatures.^ 

• The thir4 standard monitors \ the quality of sep^ice in. terms of re- 
habilitation rate , tvsing-the traditional data elements of .percent of clo-^ 
sures which are successful (the 26 closure) and annual change in the 
number of 26 closures,. 'These-^ata elements have'a long histqry of use 
and acceptance in state programs as measures of how many clients VR is. 
successfully serving • 

• The fourth standard focuses on whether rehabilitated cli^ents evi- 
dence economic independence , recognizing that VR*s most basic purpose is 
to assist disabled persons in finding gainful employment that will permit 
their economic self-sufficiency. Two data elements conpare the wjages 
achieved by rehabilitants to national ^standards* (the minimum wage) and to 

. state norms (earnings of eii5)loyees in the state) . These again are measures 
of the qxaality of service outcomes* 

• The fifth standard focuses on gainful activity for both competitive 
and non-competxtive employment closures, in order to assess the quality 

of closures obtained by VR agencies. The first two data elements mea!sure 
the gercent of 26 closures who achieve competitive employment, and among * 
these tjie percent employed at or above the natioi^al y^andards of the 
mjnini^nn w^ge. The last data element recognizes that competitive employ- 
ment mi^'not be^ the appropriate placement for all clients, but that it 
still is important that rehabilitation services achieve improvements in 
gainful activity for those clients for wlji))m employment is not thfe goal, » 
For non-competitive closures, then, a data element measures the percent 
showing improvements, in function and life statxis. Tl^e instrtmentation 
for determining such improvements is being developed by others for in- 
clusion in the MIS, and iwill be pretested in subsequent years- by RSA. ^ 

* / ■ • 



The model is to be expanded by incorporation of subsystems being de- 
veloped by the Texas Institute for Rehabilitation Research (TIRR) for taking 
into account the non-monetary benefits of increased functional capacity and 
other aspects of independent living. 
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• The sixth standard is directed at meastiring client change before 
and. after services. The first daita element focxises on vocational improve- 
ment,- as measured by changes in client earnings after receipt of VR ' 
services. The second data element focxises on non-vocational gains, and 



will be implemented after coii5)letion of the above-noted ^MIS developments.. 

♦ The seventh standard again monitors quality of service outcome and 
overall program effectiveness, and focuses on the rg^ntion of ^client 
benefits from VR services over time. The data elemen^fe draw on follow- 

up data after case closure to monitor retention of eaftiings by, individual 
26 closureXi the percent of 2b closures who remain non-dependent on public 
assistance their, primary source of support, ,and the percent of non- 
competitively employed 26 closures who retain their enhanced iiWependent 
living and functional skills. (The last data element again requires 
further MIS developments,) 

• The eighth and last performance standard monitors the consumer's 
^appraisal of services; that is, client satisfaction with VR services. Two 
data elements ^clude measures of client satisfaction with overall services 
and various aspects o£ services (e.g.^ counselor promptness, the quality 
of placement service^. The third data element moves beyond satisfaction 
•to monitor the client's ju4gement that services received were xiseful in 
obtaining and functioning in their job or homemaking situation. . 

Thus far, we have only disciissed the Performance Standards. In addi- 
tion^ the revised Program Standards include, five Procedural Standards that 
focus attention of critical process areas and on data validity. The data 
^elements foit these standards consist of a number of in&ividual items . 
•gathered .through case review, using modifications of the Case Review 
Schedule developed by the gan Diego State RCEP IX. The Procedural Stan- 
dards focus on the validity and completeness of R-300 data, the need fot * 
eligibility decisions to be based on adequate diagnostic data^and to con- 
form to federal laws and regulation, the desirability for eligibility 
decisions and movement through the'VR process to be completed in a timely 
manner appropriate to the needs of clients, the need] for compliance with 
the requirement for the Individualized Written Rehabilitatiqn Program, and 
the need for realistic goal-setting for clients^and adherence tc/ the policy 
of seeking competitive employment outcomes when ; feasible. 
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Abandoned in the Program Standards revision- are those elements in 
'the existing standards which focused on post -employment services, manageabie- 
^ised caseloads, the reasons for unsuccessful rphabijitation, and the. i 
lepgth in time of the service process. The proposed new performance 
standards monitor outcomes, cost-effectiveness, and key procedural issues. 

The Process for Setting Performance Objectives 



¥ r~- — ^ 

the 



A major shift in the proposed standards system is for state agencies 
to set_their own objectives, in terms of levels of expected performance 
by. which the state program is to monitored and "held accountable." The 
existing standards draw^on central tendency statistics to judge whether 
a state program performed adeq^tely in the past year. The central ten- 
dency statistical approach, while descripMve, does not examine the level 
of ty^cal performance witri^hat is seasonable, or v^esirable, but instead 
automatically generates "failures" and "successes" among state programs.^ 
The more that state agencies are fairly similar in performance in terms 
of some data element, the more arbitrary the* central tendency approach 
becomes. Finally, because the central tendency approach requires the data ^ 
for all state programs to be available so that the distribjution could be 
calculated, -performance "norms" for state programs are dependent on the * 
timeliness of state submissions of data. ^ 

The n4w system for setting performance objectives places responsibility 
within^ eacA, state to s6t its. own objectives for the level of performance 
to be achieved in 'an upcoming fiscal year, rather than continuing with 
the post-hoc system based on national norms • When setting performance 
objectives, state agencies might be antic3l4)ated to look at their past 
performance, at the levels ^of performance being achieved by other state 
programs that agency staff Mew as conqjar-able, at the performance nation- 
wide, and at pending changes in state economic conditions, policies on 
client and service mix, and other unique state -factors which might affect 
performance. RSA will provide technical assi,stance to the state agency 
in identi^ring appropriate levels, and/participate in the state's setting 
of its goals, but the lead and principal responsibility, in setting ob- 
jectives for performance for the coming fiscal year would be with the* 

's 

/ 
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State agency ♦ The new system recognizes that state -^encies best under- 
stand the needs of their programs, that there are appropriate differences 
among state agencies in policy priorities, and thatit'is the state agency 
which must accept that there are performance problems or shortfalls if 
needed improvements are to be identified and implemented. 
^ A particular advantage of this reliance on state agencies to set 
performance l^vel objectives is that it permits the standaaf^s system tol 
be used for monitoring and assessing the ongoing program. State agen- 
cies can use their in-house data systems to monitor individual data items 
on a monthly or quarterly basis, and to see if the program is on target 
in terms^ of moving toward annual goals or sustaiAiing accjsptable rates o;f 
quality closures. Thus, the standai;ds evaluation system can provide much 
inpre immediate feed^ck to program management to lead to improvements in 
performance. ^ 

The Reporting System / ^ ^ 

• The^ole of the reporting system in the standards system is to provi^de 
the vehicle for bringlfng tcjgether the vaifious sourcifs of data so thit a 
particular agenc^^^s-^ttainment for a specific time period can be compared 
to its obj^^rives fot the period. In addition, the reporting system will 
providg...p^gram managers with the capability to flag and investigate problem- 



atic attainment, as we shall describe subsequently. To do. these , two 
things, a reporting system has been^ designe^ to: 

• keep track of past performance as well as current expecta- 
tions ; 

• present the findings in an easy to use, easy to understand 
way, without unwieldy reports, emphasizing graphical presen- 
tations as well as plain numbers; and 

• make sure that the reporting of results occurs in a 
timely fashion, so that futufre performance can be 
affected. ' . 

The new data collection, requirements for the standards system are 
described later in these Guidance' Materials. The procedures and sources 
have been integrated with t^ie Management Information System (MIS) being 
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developed separately by RSA and Abt Associated, Indeed, the refined 
standards have been made the centerpiece of the MIS since they focus on 

f <he program outcomes aijd achievement of overall program goals. The MIS, 

while obviously serving many additional objectives as well, will readily 
provide information to state agencies that would show performance in terms 
of the standards and also be usable in identifying how to improve per- 
formance. However, even if the MIS unexpectedly were to be delayed in 
implementation, the standards system is compatible with the kinds of program 
Idata compilations routinely generated even now in many state agencies* 
internal information systeifs. Thus, the evaluation standards system cpuld 
be adapted by individual state agencies for their use, quite independent^ly 

<^ ofRSA's development of the national MIS. 

^ Data-Based Decision-Support System; Investigating Problematic Attainment 
t^hrough Supportive Evaluation ' 

Out of the standards reporting system will come the ^clear indication 
tha:t some agencies will not have met their' objectives for level of attain- 
ment on some dat^ elements. The standards system does not stop there, how- 
ever, but instead provide^ a system for investigating the causes for 
problematic attainment and for developing corrective actions as part of 
the -decision-3{q)port system. This system is described in detail in 
the Anal>"6>ic Paradigm for the VR Program Standards ,^ but can be illustrated 
briefly here. Basically, the decision-st5>port system is designed to 
provide VR program managers with information which is: 

< • relevant to the i'ssues (i.e., problems) under consideration; 

• quickly and easily interpret able; ' 



timely; and ^ 
• suggestive either of an immediate policy rdjj|tonse to the 
problem, or of further ii(v?stlgation needed before, an 
appropriate response can be formulated. 



Berkeley Planning Associates, Program Standards Evaluation 
System, Final Report Volume II, Analytic Paradigm for the VR Prograro 
Standards . This report is available from RSA.* 
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The basic flow of the decision -support system in shown in Figure 
2. Problematic attainment, where an agency is tmable to meet its agreed- 
upon objective for a particular standard data elemen^r, is the signal for 
the process to 'start. First, program managers mthin RSA and wiithin the 
state VR agencies investigate the problematic attainment. If they are 
able to -identify problems and possible corrective actions, then imple- 
mentation is the next step. If not, then more fofmal evaluation research 
is called for. Implementation of the corrective^ actions wi^l affect state 
VR agency operations in the next cycle of the standards system. As a 
result of the, corrective actions, the agency may be able to meet its ob- 
jectives. Otherwise, the cycle starts anew. 

As noted, the investigation of problematic attainment has been broken 
into two p^rts: - 

• - basic probp.em identification , carried out by program 

managers within RSA and within the state VR agencies, 
using the standards reporting system plus the managers 
knowledge of program operations; and 

• e V al uat i oW^I&s e ar ch , carried out by evaluation researchers 
within RSA or within the state VR* agencies, or ,by outside 
consultants, using the proposed MIS and other data bases, 
as well as requiring primary data collection. 

These two parts differ in who carries them out, but especially to the ex- 
tent that the basic problem identification occurs in a timely fashion, 
using* the reporting, system and the MIS. If evaluation research is re- 
quired, then most likely corrective actions will not be possible in time 
for the next cycle of the process. In fact, the results o§ the evaluation 
research may not be available for a year or more, given the nature of 
evaluation research. This lag \s the reason that the investigation of 
problematic attainment is broken into two parts, ;so that timely corrective 
actions can be taken, if possible. 

The Process of Problem Id^tification 

The process of problem identification outlined below is to be carried 
out by program managers, within RSA and within state VR agencies. The 
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Figure 2 ' 
The FloH of the Decision-Support System 
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information for the problem identification will come from the standards 
reporting system incorporated within the MIS, as. well as from the managers* 
knowledge of program operations. The process consists of tracing the pos-* 
sible problems by first organizing the components of the standard, then 
examining as "second-level" indicators other data^lements and other in- - . 
foniiationa.1 elements of the reporting system. Examination^ these will \*-* 
then lead to further examination of third-level indicators, and so on. 
At any point in tracing out these indicators the problem may be identified 
to the manager's satisfaction. At that point, corrective ]a:ction is formu- 
lated. Or, at any point* in tracing out these problems, further analysis 
in the form of evaluation research may be required. This process is like 
that normally illustrated by a decision tree. Of course, the process of 
problem identification may lead down several paths at once. Also, more than 
two paths may nee,d investigation^ from a particular hode, or more than 
three levels of indicators may have to be examined. The point is to do 
the analytical thinking and utilize existing' information ta identify pos- 
sible problems and corrective actions. This process is illustrated in 
Figiire 3. 

If a data element shows problematic attainment, the first level of 
analysis is to examine the components of the element, dis.secting the ratio 
or measure into its separate. parts, to pinpoint the areas needing attention • 
For example, Tf the numerical value of a ratio is too large, the problem 
may be. in the numerator (too large), the denominator (too small), or both. 
Comparison of attainment on the data elements or their components with that 
jof other agencies with similar programs, or historically, or on other data 
items, can help determine the extent to which the indicator shows a real 
problem or if there is a good explanation for the attainment. The goal in 
this analysis is to seek explanation , or the identification of which 
components or related measures pinpoint the ares to be explored further. 
This analytical process may take several iterations before a cause is 
pinpointed. The first levels of the process, are not to be seen as complex 
statistical analysis problems, but rather straightforward, simple program 
comparisons that allow VR managers to progress through a decision tree, 
diagnosing problems and using program information to reach conclusions 



Figure 3 
Process of Problem Identification 
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^An ^'informational element" is a piece of data that comes from the MIS or other reporting system, but 
is not a stamlards data element. " , • 
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about probable causes. Some branches of a decision tree process may lead 
to problems or investigations that require complex statistical analyses, 
but' only after several levels of the process have occiirred. 

Table 2 shows the decision steps in an example exploration; this is 
a model for investigating the possible causes or problems if "expenditures 
per 26 closure" (data element 2(ii)) is problematic. 

The column showing "first level indicators" shows four possible com- 
binations of two other indicators, cost/closure and cost/case, which are 
used to investigate an tmacceptable (high) value of data element 2(ii). 
Depending on acceptable or unacceptable levels of these indicators, a 
different "scenatio," or type of problem, is identified. For instance, 
if both of these indicators are "acceptable," then this indicates that 
the agency is achieving a proportion of 26 closures which is too low. 
This (An be confirmed by referring^to data element 3(i). 'If cost/closure 
is. unacceptable, but the cost/case is acceptable, then the agency is achiev- 
ing too few closures. As can be seen here, this first-level diagnosis 
leads to in-depth investigation of different parts of the system. The 
table shows the types of second- and third-level questions that could be 
pursued, depending on the initial comparisons and explanation. 

A^t each level of the investigation, the goal should be to quickly and 
more finely hone in on the precise nature (i.e.', cause) pf the problem. 
Depending on the findings generated by a given level of the .analysis, the 
program manager may decide either: that further investigation is w^anted 
before formulating a policy response; that the findings are adequate to 
suggest an appropriate response;, or that, despite the adequacy of the 
findings, no useful -policy response can be offered (e.g., due to prior 
institutional, legislative, or funding constraints). 

The indicators used in the investigation of problematic attainment 
are grouped and sequexiced ia such a way as to answer increasingly detailed 
questions. This^ allows managers to go a fair distance in determining the 
nature of the problem before needing recourse to more sophisticated and 



Ifhe Analytic Paradigm provides similar decision trees for other 
Performance Standards dkta elements. 



29 



Table 2 

Investifting Intdatjaau Perfonmnce on Data Eleaent 2(ii) ; 
Expenditures yer 26 Closure 



Scen- 
ario 



First Level Indicators 
Cost/Closiircl Cost/Case 



Impli- 
cations of 
First Level 
Indicators 



Second Level 
Indicators 



^'Leading 

Questions" 
(and answer) 



Third L«vel 

Indicators 

(if applicable) 



Research Questions 



Acceptable 



Acceptable^ 



Ai^enc/ is 
achieving 
too low a 
proportion 
of 26 clo- 
sures 



Standards Data 
Eleaent 3{i) 

<I26 \ 



Is the \ too 
low? 



None (go to next 

COlUMl) 



Conduct OutcoMes Analysis 



^•26*i2S*i30y 



If no» which 
clients or 
coi^)onents 
co$t too 
■uch? 



• Adainistratioa 
costs 



1. What proportion of totitl costs go to ad- 
•inistration? 



• Service costs 
to; 

— 26s 

— 28s and 303 
08s 

(froa the HIS^ 



2. What is the average life-of-case cost for 
each closure^ group? 

3. Wlut proportion ^f total life-of-case 
costs are spent on each~ch»ure ^roup? 



• Service costs 
by service 
type 



1 . What proportion of current service costs 
went to each service type? 

2. What is the average cost of each service 
type, for clients receiving that service? 



Which aspect of services for accepted clients 
takes relatively too ' long? 



Un- 
acceptable 



Acceptable 



Agency is 
serving 
clients. ^ 
too 

slowly : 
achieving 
too ^ew 
closures 



MIS element : 

Post-Acceptance 

Closure 

Rate 

/ 1l26»i28»i30 ^ 
lyl open cases/ 



I. U the 
service 
process 
too slow? 



1. Tiaeliness 
10-12/12-24 

300 itea 3,M,2 
Averi^e tiae froa 
acceptance to 
closure (10-24) 



2. Ilave we 
had> a recent 
influx of 
acceptances? 
* 



MIS elenent: f 
rate of 
acceptance 



None (end of investigation) 



Acceptable^ 



ucccptable 



Agency has 

recently 

developed 

a bottre- 

neck in 

intake 

process: 

too few 

clients 

being 

accepted 

into the 

system 



I. Standards Data 
Element l(ii) 
1l served (10-30) 



(! 



100»000 population, 

MIS element: 
Rate of Acceptance 



I . Do we have 
too few 
agglicants? 



f of applicants 
(From ;iSA-l0l) 



Could outreach be made more effective? 



i of new status lOs^ 



I new applicants 
I on-hand applicants] 
I onrhand 06s / 



Docs use 
of Extended 
Evaluation 
account for 
the low 
acceptance 
rate? 



I. R-300 item 3MI 
TIP06 (06 takes 
too^long) ^_ 



MIS element: 
02 «>06 
(too many enter 
06) 



1. What kinds of clients are going into 06? 

2. Wiiat kinds of services are provided during 
06? . ' ♦ 



3. Do we have 
too many in- 
eligible 
applicants? 



MIS elements: 
02 «>* 08 and 
06 '> 08 



1. Vhat reasons are given for closing clients 
ineligible? 

2, From where are these clients being 
referred? • 



acceptable 



Uii- 

uccpp table 



Agency has 
both an 
intake and 
a timeli- 
ness 



Same as 2 and 3 



Same as 2 and 3 




21 



time-consuming "causal" analyses. This is not to say thk^^her sophis- 
ticated analyses are undesirable or unnecessary. On the contrary, they 
as often as ngt may prove useful to managers in pinpointing precise causes 
of problem performance. However, the advantage of this model is that it 
allows. managers to quickly investigate and discard certain hypotheses re- 
garding the problem's cause, and therefore to more quickly -direct the 
investigation toward what seems to be the likely cause. Once the likely 
cause is ISentified through use of the indicators, the manager can direct 
the evaluation/research staff to conduct the needed causal analyses • 
* ) 

Evalua tion Research 

% ~- 

As noted above, corrective actions may not always result from the 
problem identification procedure. Instead, the program manager may need 
to conduct "catisal" evaluation research and program analyses to determine 
the source of program performance problems. These (often nniltivariate) 
analjrses control for various state factors which simultaneously influence 
performance. Such res.earch often examines the VR program as an inter- 
relate^ system of activities and may require special data collection. 

Summary 

This concludes the description of the revised Program Standards system. 
The system includes a set of Performance and Procedural^ Standards and as- 
sociated data elements, a new procedure for setting performance goals by 
states, a reporting system to provide information on performance, and a 
data-based decision-support system to assist progf,am managers in analyzing 
and interpreting perfo]jftance data as a tool for program improvement. 

The new standards evaluation system promises to solvd'a number of long- 
standing rehabilitation program needs: it provides an evaluation frame- 
work for monitoring performance based on program outcomes; i| places the 
leadership role for deciding how to improve performance with the state 
agency; it provides a workable evaluation system linked with an agency MIS; 
it provides a clear role for RSA as the source of technical assistance to 
the states, the developer of basic systems technology for helping states 
in eyaluation, and the periodic conduct of special evaluation studies 



that would be infeasible or inefficiently moxmted by a single state. 
However, before this' can occixr, the system must be implemented in RSA and 
state VR agencies. The purpose of these Guidance Materials is to ease 
implementation by describing the various "input components" of the system 
~ that is, standards, data elements, data collection forms, and reporting 
systems — which must be made operational ^in. order for the system to serve 
its function as a tool for improved program performance. To this end, we 
turn next to a discussion of the Performance Standards. 
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II. GUIDE TO THE PERFORMANCE STANDARDS SYSTEM 

The Performance Standards consist of eight goal-statements for the 
VR program, and "data elements" to be used in measuring achievement of those 
goals, ^e Performance Standards focus on "outputs" of the VR program: 
'xhat is, on client outcomes and agency productivity. They provide measures 
of an agency's level of coverage of the eligible population, efficiency in 
service provision, and impact on clients' lives. 

The Performance Standards will be reported each fiscal year. State 
agencies will submit the required data to RSA, and RSA will compute the data 
elements and produce a Standards Report for each state agency. RSA will use 
the management infonnation system (MiS) to store and analyze the data. 

States already routinely collect. much of the data required by, the Per- - 
formance Standards. Of the seven separate data sources used for the Perform-^ 
ance Standards*, three are routine RSA reports: 

• the^ RSA-300 Case Service Report (providing data on individual . 
client outcomes); 

• the RSA-2 Annual Report for Vocational Rehabilitation (provid- 
ing data on aggregate agency expenditures); and 

• the RSA- 113 Quarterly Cumulative Caseload/Expenditure Report 
(provi^ding data on the agenc^s caseload flow). 

The RSA-300 report has been expanded to provide certain additional data 
.^qeds required by the Performance Standards. It ha$ four parts which are 
completed at different points in .the rehabilitation process': at first refer- 
ral, at completion of the referral process, at completion of the IWRP, and 
at closure. The information gathered pertains to the clients' work status, 
disability, -primary source of support, the results of their movement through 
the VR system, and other demographic and personal information. 

The RSA-2 has been discontinued by RSA, and the report's information is 
part of the proposed RSA-113. However, we retain a reference to the RSA^2 i 
because the RSA-113 financial information is insufficiently detailed for the 
benefitrcost data elements. Ou^concem is to show data collectors the type 

' . u 34 / ^ 
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of information required; thus we include the RSA- 2 to illustrate the specific 
information nee^d. The precise location of the data (i.e., the report 
containing the needed information) is irrelevant, as long as the data is 
accessible from somewhere within the state agency accounting system. 

Th? RSA- 113 is a new report created by RSA to gather quarterly informa- 
tion about client flow within each VR agency. It shows how many clients the . 
agency accepted in the previous quarter, how many closures were made during 
the previous quarter,, and the types of closures. As well, the report provides 
information on the number of applicants and entrants in extended evaluation; 
gives projections on new acceptances and rehabilitations; and provides infor- 
mation on expenditures. However, as noted above, the expenditure information 
is insufficiently detailed for some data elements. 

RSA is currently involved in efforts to revise the RSA- 300 and RSA- 113 

reports, in response to 0MB requirements. Because of this, tnfe reader should 
« 

be aware that the . references to specific data items, madjs in this report, may 
not correspond exactly to the actual location of the data items once the 
reports* forms are finalized. Nonetheless, although the location of the 
require^d data may, change, the content of the data will not. That is, RSA 
has ensured the availability of all program- related data required to implement 
the Performance Standards, v \ 

In addition to the three program reports used for the Performance Stand- 
ards, the standards will also require iiftplementation of two different clie^- 
surveys : 

• the Client Closure Survey (providing information on client 
satisfaction with VR services); and 

• the Client Follow-up Survey (providing information on client 
retention of benefits). , 

These two surveys are administered as mai 1 -back* surveys , completed by a 
sample subset of the agency's total group of closed clients for the given 



1 

As of late October 1980, Berkeley Plannihg Associate^ received indica- 
tions that the revisions tb the RSA-113 would include the detailed financial, 
information needed for the benefit-cost data elements. ^ If true, this would 
remove the' need to maintain the RSA-2 or, other additional reports beyond the 
RSA-113. 
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fiscal year. The Closure Survey functions as the data source for measuring 
a client's satisfaction with various ^pects of his/her VR services. In 
order to tap the person's opinions while the Vr experience is still "fresh • 




in mind," the survey must be administered as soon as possible after closure 
from VR. In contrast, the Follow-up Survey is used to measure clients' 
success in maintaining, over time, the "benefits" resulting from VR service: 
thus it is concerned with whether or not rehabilitated clients have retained 
their jobs, earnings levels, freedom from public assistance, and functional 
abilities. The Follbw-up Survey is sent to the client one-year .after closure 
from VR. 

Finally, implementation ^the Performance Standards will require access 
ing two "exogenous" data sources : 

• the annual U.S. Census publication Statistical Abstract of the 
U.S. (to provide data on the current federal minimum wage and 
on state wage norms); and 

• ^e U.S* Bureau of the Censxis Current Population Reports , 
Series P-25 (to provide state population estimates). ^ 

Each of these data sources will be accessed by RSA, and RSA will input thf 
required^ data^into the MIS for computing of th€'>edevarit data elements. . 

To summarize, the Performance Standards address eight output goals of 
the VR program, and require data from three program documents, two client 
surveys, and two "exogenous" sources. With this overview, we next turn to a 
detailed discussion of the Performance Standards, their data elements, and 
the various data collection instruments. The disctission of the standard's and 
data elements indlude: a brief description of the rationale for including 
the standard or data element in the Performance Standards; the formula of 
each data element; and the data sources for each data element. After these 
discussions, we present a summary table with instructions for computiftg the 
data elements (definition of terms and data specifications). Following thisi 
each of the data sources are presented, with instructions for their implement- 



ation. 
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THE EIGHT PBkFORMANCE STANDARDS 

STANDARD 1 : VOCATIONAL REHABILITATION ^HALL SERVE THE MAXIMUM PROPORTION OF 
THE POTENTIALLY ELIGIBLE TARGET POPULATION, SUBJECT TO THE LEVEL 
OF FEDERAL PROGRAM FUNDING AND PRIORITIES AMOHG. CLIENTS . 

Data Elemenfs: • (i) Clients served per 1(?0,000 population 
(ii) Percent severely disabled s^if^^d 

This standard addresses coverage, or the extent to which the vocational 
rehabilitation program is serving the. eligible target population^ The need 
to ensure accessibility of services to all the eligible disabled i's of para- 
mount iii5)ortance to RSA and l:he states.^ Alone » this standard ignores consid- 
derations of the qu^ii^y of the coverage (i.e., the appropriateness and utility 
of the program's activities in the clients' behalf, and the clients' service 
outcomes). However, these considerations are addressed by other standards. 

Data Element LCi) : Clients served per 100,000 population — 
Rationale: 

Although this data element does not prpvicJ^- a^true estimate of the level 
of coverage of the eligible target populatiiA',; it^ a useful purpose 

(a) by providing a proxy measure of the sizl6i.^'.'tlte target population in 
terms of the total state population; and (b) because it is used now by state, 
agencies, it already l^as management utility ^d validity as a performance 
measure . 

Formula : 

• served in a given year 

State population (in 100,000 's) 

Data Sources : 

• RSA- 113 

• U.S. Breau of the Census, Series P-2S 
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^ 27 

Data'£r<gra^&iit l(ii) : Percent severely disabl^ served 
Rationale: 

^ 4 

The proportion of severely disabled within a caseload can reasonably be 
expected to impact negatively on a state agency's total voltune (i»e», case- 
load size) and on its costs. With a high proportion of severely disabled 
clients, time in process would be expected to increase and?^ counselor capacity 
decrease, thu5 decreasing a program's caseload volume potential; that is, a 
decreaije in coverage ♦ To effectively assess coverage, the proportion of the 
caseload that is severely disabled must be taken into account ♦ Further, given 
the legislative importance attached to service to severely disabled, it is 
most appropriate to include this data element under the standard, on coverage 
of the eligible client population. 

Formula ; 

# severely disabled served in a given year 
Total * served in a given year \ 

Data Sources ; 

• RSA-113 
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STANDARD 2: THE VOCATIONAL REHABILITATION PROGRAM SHALL USE RESOURCES IN A 
COST-EFFECTIVE MANNER AND SHOW A POSITIVE RETURN TO^^SOCIETY OF 
INVESTMENT IN VOCATIONAL REHABILITATION OF DISABLED CLIENTS . • 

Data Elements: (i) Expenditure per competitively employed 26 closure 
(ii) Expenditure per 26 closure 
(iii) Ratio of total VR benefits to total VR costs 
(benefit-cost ratio) 
(iv) Total net benefit from VR seirices (discounted, 
net present value) 

Two issues are addressed by this standard. The first is the issue of 
cost-effectiveness: with the financial resources available to the state, 
how successfully did it achieve desire4 objectives? The second issue revolves 
around/ cost-benefit concerns (i.e., "return on investment"). Specifically, 
thg^^andard asks the question: Are we getting more out of the program than 
we put in? 

Data Element 2(i): Expenditure j)er competitively employed ^6 closure 
Rationale : 

This data element compares total agency expenditures to the number of 
competitively empjloyed 26 closures. It applies the most stringent criteria 
t^ the measurement of cost-effectiveness by focxisiiig on only those 26 closures 
who are competitively employed. The data element is very similar to data 
element 2(ii) (expenditure per 26 closure). However, it is included because, 
historically and even today, a consenstis exists that competitive employment 
is the highest quality and most desirable type of closure obtainable • Thus 
data element 2(i) allows agencies to measure the cost-effectiveness of their 
services in terms of VJl's highest goal: achievement of competitive employment. 

Formula : 

Total agency expenditures 

^ competitively employed 26 closures 

Data Sources : 

• RSA-2 . 

• RSA-300 .39 
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Data Element 2(ii): Expenditure per 26 closure 
Rationale : 

This cost-effectiveness measure relaxes the measurement criteria some- 
what to allow ♦♦credit'* for all types of rehabilitations. It recognizes that 
some clients are not capable of achieving competitive employment and that 
other employment outcomes can represent achievement commensurate with a 
client's abilities. This data element compares total agency expenditures to 
all 26 closures, thus capturing the effect of gainful activity, whether it 
lies in the realm of competitive or non-competitive employment. 

Formula : 

Total agency expenditures 
# 26 closures 



Data Sources: ^ 

• RSA-2 

• RSA-300 
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Data Elements 2Xiii) and (iv) 



Ciii) Ratio of total VR benefits to total VR costs (Benefit>Co$t ^ratioj ) 
(iv) Net total benefit from VR services (Discounted net present value) 

Rationale and Discussion 

These two data elements are very simxla^n concept, and they will.^ 
be discussed together/ Benefit-cost modeling of spcial service^ delivery 
systems ,enjo^s current wide acceptance as a measurement tool. Its use 
extends considerably beyond the VR, field.. ,The figures^^roAdted^, by benefit- 
cost, analysis yield a single number which is an immediate inHtaator o£ 
program si^ccess. Unlike cost-effectiveness measures, which determjine the 
unit costs for achieving a given objective (such as costs per compXfitive 
closure) , benefit-cost models estimate total benefits and total costs^ in 
terms of dollars. TTiese models are neutral with regard to type of delivery 
strategy. As such, they do not penalize agencies which choose to spend 
more per client in order to produce better results. Because of their sur- 
face siiiylicity, and becaxise they are a popular sophis.ticated analytJt£- 
tool for evaluating program* worth, benefit-cost measures of the VRWstem 
are included in the Performance slfendards. - _ ' y 

^ As a review for the National Science Foundation has noted, benefit- 
cost application^ in the YR field are more extensiye and have genei^lly 
been more sophisticated (or at least at a higher level of technical quality) ^ 
than in most other social service and manpower .-program areas. There are 
a' number-, of models available for tise. Jn one case, RSA commissioned the ^ 
development of a model fpr routine use by the program, which was designed 
to be adaptable to' the needs of many us^rs (i.e., state agencies, RSA con- 
tracted evaluation studies, RSA itself) and to be capable of periodic up- 
dating and refinement as .new data became available. That mqdel, developed , 
at the University of California, Berkeley, and- subsequently refined by BPA ' 
staff, has been used by RSA, several state agencies, the Urban Institute, 
Abt Associates, National Analysts, and Greenleigh Associates, among others,;- 



"^Berkowitz and Anderson, PADEC An Evaluation of an Experimental 
Rehabilitation Project , Rutgers University, 1974. 
— ' ^ ' 
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I • • . \ ' 
Data Elements 2(iii) and iv^4-<^tinued)™^_„_™. — « — . — 

usually under RSA recommendation. This model is the basis for the two ^ 
data elements proposed for use in measuring benefits in relation to costs 
in terms of: ^ , • ' 



• a ratio 



Y Beriefits\ 
\ ^Costs / 




a net ^difference (Benefits-C6sts) 

Currently, the BPA model does not account for gains in functional 
abiTity apd life status (although it does include monetary valuations fog: 
the unpaid output of non-wage-eaming rehabilitants) . However, the model 
is currently undergoing revision by a project at the Texas Institute fqr 
Rehabilitation (TIRRj^/wiich will develop subsystems within the mode'^. to 
account for such fifiictional and life status gains. Because of . th^frf^l^- 



pendin^ revisions, we^ cannot include the precise mathematical forlnUlation 
for the model in these Guidance Materials. However, upon final revision, 
the benefit-cost model will be incorporated within the MIS, and the inter- 
ested reader can obtain documentation on the mathematical formulation from 
RSA. Further, we can specify the conq)onents of program benefits and 
program costs which 2^re in the current version of the model, and which will 
remain after final revision. 

Both of the benefit-cost^ data elements use the discounted present 
2 

value of social benefits and costs*, and both use the same components to 
arrive at benefits and costs.. These con^jonents, in brief, are as follows: 



Fredeirick C. Collignon and Richard Dodson, Benefit-Cgst Analysis of 
Vocational Rehabilitation Services Provided to Individuals Most* Severely 
Handicapped (ISHH) , April 1975. 

2 

A con^jarison of the full costs and benefits of a VR program can be 
undertaken from several perspectives. Perhaps the most common benefit-cost 
perspectives are the "taxpayer" perspective and the "social!* perspective. 
In taxpayer BC, we conipare direct administrative and service costs of the 
VR program as^^ell as the costs of other government agencies providing 
benefits and services to the client population (SSI, SSDI, Food Stamps, * 
Medic^e,* other employment and supportive services) with benefits such as 
taxes that successful rehabijitants pay from their earnings and saVings 
in public assistance. Social BC takes tlie broadest perspective, incorpor- 
ating the widest range of costs and benefits and including on the cost side, 
for example, costs borne by clients and, bn the benefit side, client 
'earnings as an addition to the GNP. 

'42. .. 
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Data Elements 2(iii) and (iv) (continued) 
Benefits 



c 



discounted value of paid earnings; 
change in output of homemaker closures; 
, • change in output of unpaid family workers; 

• change in "after hours woric" (e»g»> homemaking tasks per- 
- formici by wage-earning rehabilitants); 

• fringe benefits; 

change in output of families of rehabilitants (as a result 
^of rehabilitants assuming homemaker tasks); 

• reductions in public assistance benefits; 

• repeater costs (a "negative benefit") . 

Costs 



total] program costs during the fiscal year, minus carry- 
over costs and maintenance costs; 



• 'cosjs borne by parties other than VR;* 

• research, training, and demonstration costs; 

• benefits foregone by clients during participation in VR 
services (i.e., any. wages and fringe benefits foregone 
by clients with earnings at referral) ; and 

f client-borne costs for VR services. 

The model uses two basic types of input: (1) "variables" which are 
input or computed from program documents (e.g», the RSA-300 and RSA-113) 
for the year in (Question; and (2) "parameters" wliidi take the form of con- 
stants which are derived by estimation or inference based on previous re- 
lated research^ current macroeconomic conditions, and so forth. Again, we 
cannot include an exhaustive list of all the input variables and parameters 
which will be required by the final revised model. However, in Appendix 1 
the reader will find a listing of the program ^ta which is used. to compute 
the variables (as opposed to the parameters) used in the current version 
of the model. Upon final model revision, the interested reader may obtain 
documentation on all input variables and parameters from RSA* 

A few final notes are in order with regard to the components of the 
current version of the model, as listed above* The cost^ associated with 
homemakers and unpaid family workers are the same as those for any other - 
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Data Elements 2Ciii) and (iv) (continued^^— — ^•^-^^ — , 

26 closure. The benefits of a homemaker are determined by estimating the 
"worth** of homemakers in the general population; that is, by estimating 
the dollar value of the various functions performed. by a homemaker. The 
worth of disabled homemakers is assumed tcf be soae proportion (less than 1) 
of the worth of homemakers in general. This proportion is then estimated to 
be the same as the proportionate worth of disabled workers to Jiormal workers 
Unpaid family workers are treated similar/. The value of a sheltered work- 
shop employee is his/her market value, i.e., his/her wages, .regardless of 
whether they are above or 'be low the minimum wage. 

There is a term in theT model for workers who have been displaced by 
handicapped workers. The term estimates^ the negative impact on these dis- 
placed^ workers. The term currently has a value of zero because there is 
no evidence of substantial impact in today's economy. This is> of course, 
not relevant to BEP or sheltered wprkshop employees. 

The net benefit measure (B-C) is ^gluded among the standards data 
elements primarily because it is the pf<^erred approach of economists # 
The problem with the measure is that it is very sensitive to the stale of 
program operation: in the case of VR, for example, larger agencies would, 
produce greater total net benefits than small agencies, simply becaus^e of 
their larger caseloads. Thus, the measure is inappropriate for comparing 
across state agencies, although it is tiseful for observing change over 
time within an agency. The ratio measure (B/C) overcomes the problem of 
agency size, thus allowing comparison across agencies. As well, B/C can 
be used to" observe change over time within a single agency. 

Formula : - , 

« . .V [ Benefits\ . * 

\ Costs I 

2(iv) (Benefits -.Costs) 
Data Sources: 

• RSA-300 ^ 

• RSA-2 
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Data Elements 2(111) and (iv) (continued) 

• RSA-113 

• Follow-up Survey 

(A listing of program data requirements for the current version 
of . the model appears in Appendix 1*) . . - 



45 



35 



STANDARD 3: VR SHAtt »tAXTMKE^THE ^aJMBER AND PROPORTION OF CLIENTS ACCEPTED 
FOR SERVICES IVHO ARE SUCCESSFULLY REHABILITATED, SUBJECT TO toI 




MEETING OE OTHER STANDARDS. 



1^5? ClJ_ Percent 26 closures 



Data El 



Cii) Annual change in number of 26 closures 

Traditionally, success in VR has been' measured by the number of "26 
closures," or successful rehabilitations obtained. The VR goal is to rehab- 
ilitate clients>,^d to ignore that goal in the standards system would be a 
serious omission. VR dbes need to know how many individuals it successfully 
serves and must have encouragement to rehabilitate as many persons in need 
as possible. * ^ 

Data Elem^t Zji): Percent 26 closures 
Rationale: 

This data element provides a straightforward me'asure of an agency's 
.success in rehabilitating the clients it accepts for services. The data 
element focuses on the proportion of clients, accepted for service , Ci^e. , 
excluding OS's), who are successfully rehabilitated. 



Formula: 



# 26 closures 



#26+28+30 closures 
Data Sources: 



RSA-113 
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Data Element 5Cii"): Annual change in number of 26 closures 



Rationale : 

This data element attempts to assess an agency's success in maximizing 
the number of clients, accepted for services, whb are successfully rehabili- 
tated. ^ The measure uses the state agency's prior performance as a baseline 
for determining success in "maximization:" that is, an agency is judged to 
have maximized the number of rehabilitants if it has increased the number of 
26 closures by some previously specified amount- That amount will have been 
"^sex by the state agency, in conjunction with RSA. 

Formula : 

% 

(# of 26 closures in current year) - (# of 26 closures in previous year)^ 



Data Sources ; 



• RSA-llS 



ERIC 
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" ' STANDAJ^D' 4 : REHABILITATED CLIENTS SmiX EVTDEKCE ECONOMIC INDEPENDENCE" " — 

y ' ~ • 

Data Elements: (i) Percent 26 closures with weekly earnings at/above 

federal minimum wage 

(ii) Comparison of earnings of competitively employed 
26 closures to,, earnings of employees in state , 

« 

VR's most basic purpose is to aissist disabled persons in finding gainful 
employment. One fundamental aspect of gainful employment is the ability to 
be economically self-sufficient (i.e., "independent"). 

Data Element 4(i): Percent 26 closures with weekly earnings at/above federal 

minimum^wage \ 

. Rationale :- 

In addressing economic independence, the logical place to look is to 
wages. This first data element assesses wages as they compare to the national 
standard (the federal minimum wage) . The normative implications of this data 
element are that a disabled person should ie expected, under equivalent circum- 
stances, to make at least the miniminn required "by law for citizens of the U.S. 
This data element uses the weekly minimiim wage figure as the standard rather 
than the hourly wage, because the former more accurately captures the concept 
of this Standard. Whereas hourly wage .indicates a measure of the employee's 
worth to the employer, total (i.e., weekly, mon|:hly, cumulative yearly) earn-, 
ings is a better indicator of the employee's financial well-being (i.e., how 

much money he/she makes . and whether that amount can support him/her) . If an 

♦ 

employee is able to woric only five hours a week, his/her econoioic condition 
will be affected by this as well as by the hourly rate. Thus, total earnings 
is the more appropriate indicator of economic independence. 

h 

formula: 
~ ^ 

# 26 closure^ with weekly earnings level 
at /above federal minimum wage 

# 26 closures 



Data Sources : 

• RSA-300 -> - 

# U.S. Census Bureau, Statistical Abstract of the U.S . 



ERLC 
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Data Element 4(ii): Comparison of earnings of compe'titively employed 26 

closures to earnings of employees in state 



Ra^( 



ionale : 



Thi's data element controls for state-to-state variation in earnings 
levels, whereas data element 4(i) does not. In some respects, this is a 
more comprehensive indicator than data element 4(i) because it provides an 
estimate of, clients' "standard of living" relative to other persons in the 
state. 



Formula: 



Mean weekly earnings of competitively employed 26's 
Mean weekly earnings of enqployees in state 



Data Sources : 

• RSA-300 . 

• U.S. Census Bureau, Statistical Abstract of the U.S. 
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STANDARD 5: SHALL BE MAXIMUM PLACEMENT OF REHABILITATED CLIENTS INTO 

COMPETITIVE BIPLOYMENT. NON-COMPETITIVE CLOSURES SHALL REPRE- 
SENT AN IMPROVEMENT IN GAINFUL ACTIVITY FOR THE CLIENT . 

-^Data Elements: (i) Percent- 26 closures c6mpetitively employed 

- (ii) Percent competitively^ -employed -26 closures with 
* hourly earnings at/abave the federal minimum wage 

(iii) Percent non-competitively empjj^jyed 26' closures 
showing improvement' in function and life status 

Like Standard 4, this standard concerns the .impact on clients obtained 
by VR agencies. Historically, competitive employment has been seen as the 
best kind of closure. However, competitive employment may not be the appro- 
priate placement for all clients. Still, VR regulations require that any 
placement of a successfully closed client be into "gainful and suitable j 
employment," "consistent with his/her capacities" whether in competitive, j 
sheltered, or non-competitive employment. For this reason, improvement in 
gainful activity for non-competitive closures is also included. 

Data Element 5(i): Percent 26 closures competitively employed 
Rationale : t ' 

This st^dard's bias toward corapetititve enqjloyment reflects the belief 
that vocational rehabilitation should focus on employment , preferably compet 
itive employment. For a standard emphasizing maximum placement -into competi 
tive employment, perhaps the most obvious data element is to determine the 
proportion of 26 closures placed into competitive employment . 

Formula ; , , < 

competitively employed 26 's ' . 

# 26 closures . ^ 

Data Sources : . . , 
■-■ • RSA-300 
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Data Element 5(ii): Percent competitively employed 26 closures with hourly 

^mings at/above the federal minimum wage 

Rationale : 

^-This data element applies more stringent criteria to the measurement of 
**maxiiaum placement of rehabilitated clients into competitive employment." 
It compares the number of competitively employed 26 closures with hourly 
earnings at or above the federal minimum wage to the total number of com- 
petitively employed 26 closures. As in data element 4(i), this data ele^- 
ment implies that a disabled person in the competitive labor market should 
be expected to earn at least the federal minimum wage. Unlike 4(i), however , 
this measure represents an employee's worth to the employer. Total weekly 
earnings are an indication of an OTployee's financial well-being, while his/ 
her ''worth" may be determined by examining his/her hourly wage. Thus, this 
data element provides a measure of the^ '*value" of rehabilitated VR clients 
who are in the competitive laljor market relative to the federal minimum wage, 

Formula : * . . - " ~~ 

# competitively employed 26 closures with hourly earnings- at/ 
above federal minimum wage " ^ ^ 

# competitively employed. 26 *s 

) .• . - 

Data Sources : 

• RSA-300 

• U.S. Census Bureau, Statistical Abstract of the U.S. 

% • ■ ' ' 
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Data Element S(iii): Pe&ent nQn^competitively employed "^ZS closures showing 



improvement in function and life status 



Rationale: 



Closures into non-competiti've employment may be legitimate for certain 
clients, but in order to attribute any credit to VR for "rehabilitating" ^ 
clients into non^competitive employment, there must be some indication that 
VR helped improve those clients' capacity for gainful activity. This data . 
element wild use information gathered on clients at acceptance and at closure 
using elements of the Functional Assessment Inventory (FAX) and Life Status 
Indicators (LSI) instruments. The information will be input on the client's 
RSA-300. ' However, RSA is currently undertaking a pretest-of the FAI and LSI 
items, to determine which specific items will be included on the RSA-300. 
Until completion of ^ the pretest, no data specifications can be made; thus, 
data collection will be deferred until *after the pretest. When implemented, 
the data element will have the following formula and data sources. 



Formula :- 

# non-competitive 26 's with improvement on.LSI-FAI measures 
from plan to closure ^ ^ 

# non-competitive '26 's 



Data Sources : 



• RSA-300 
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STANDARD- 6: REHABILITATED CLUENTS SHALL EVIDENCE VOCATIONAL GAINS . 

'Data Elements: (i) Average earnings change c^f 26 cldsuteg, before 

versTis after VR services 

(ii) Other changes in functional ability and. life status 

. It is axiomatic that, after VR serviceis, riehabilitated clients should 
evidence some sort of vocational gains; either in monetary or non-monetary 
terms. This standard assures that attention will be paid by the VR field to 
the level of client changes. It siq)plements the concern for measuring 
post^ervice outcomes (as in Standards 3-5) by using the client's pre- 
se3rvice circumstances .as a baseline for comparrson. 

Data Element 6(i): Average earjr^nj^SQhange of 26 closures, before versus 
Rationale ; 

.This data element is included because wages are the most straight-forward 
indicator of vocational change. Weekj*/ earnings are used to measure change. 

Formula : 

. (Sum of closure earnings for 26 closures) minus (s'im of 

referral- earnings for 26 closures) ] • 

, # 26 closures y 

* ' - 

Data Sources : 

• RSA-300 
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Data: Element 6(ii) : Changes in functional ability and .life status 
Rat 5l on ale ; , ^ 

In addition to vocational chanjge (as' measured by data element 6(i)), 
the VR program also acts as a change-^agent in. terms of ^lon-vocational aspects 
of a client's life» As with the data elements associated with non-competitive 
employment closures (as in data element S(iii)), the methodology for assessing 
non-vocational change needs development. This development should occur as 
an outgrowth of the FAI/LSI pretest for the MIS. Until such time as the 
me^ures can be developed, no data collection or reporting will be conducted 
for this data element. 
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STANDARD 7: REHABILITATED CLIENTS SHALL RETAIN THE' BENEFITS OF VR SERVICES .; 

Data Elements: (i) Percent 26 closures retaining eamil^s at follow-up 

. (ii) Comparison of 26 closures with public ,ass istance, . . 
as primary source of support at closure and at 
follow-up 
'» > 

(iii) Percent non-competitive ly employed 26 closures 

retaining closure skills at^ follow-up 

Retention of benefits gained through vacational rehabilitation*se3nrices 

is important to the rehabilitated client and as a measure of overall program 

effectiveness. Job losses following successful closure imply program failure 

and point to incongruence of program goals vis-a-vis individual client goals: 

are we ''rehabilitating'' clients temporarily to meet program objectives, then 

finding clients back vfhere they started a few months later? This question 

has a great degree of impoij^ance to fhe 'overall mission and thus a standard 

in this area is highly appropriate. Aside from employment measures of benefit 

retention, additional attention is given to expanding the data elements for 

this standard to include non-employment measures. 
* * t 

Data Element 7(i): Percent 26 closures retailing earnings at follow-up 
Rationale : ^ 

As rioted,' retention of benefits gained through VRysB3nrices is very'impor- 



gained through VRysB3nrio 
A^^hiKoverdrFeiiecti^ 



tant both to the individual client andVt^^liy overai:^ etxectiveness of the 
program* This data element looks at retention of wages earned, as one of the 
most important benefits obtained from VR. * ' • , 

Formula : , . . * 

• 26 's with earnings at closure who retained or increased 
earnings at follow-up ^ [ ' n 

r * 26 closures with earning^ at closure, surveyed at follow-up . 

Data Sources : ' ^ ' ^ 

• RSA-300 ' ... 

• Follow-up Survey (merge with RSA-300) 
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Data Element Coroparison of 26 clostires with public assistance as 

primary source of support at closure and at follow-^ip 

Rationale: 



This data element provides a needed dimension in assessing benefit- 
retention for non-corapetitiveXy as well as .competitively placed successful 
closures. Here benefits are proved by measuring the extent of .the clients' 
use of public resources. By focusing on the degree to wjiich there is a 
reduced need for public assistance, an emphasis is given to the economic 
self-sufficiency of the client in terms of stability or iraprcJvement . 

This data element requires a new definition of "primary source of support" 
(discussed later in the section of the RSA-300) , wherB "source of support'^ is 
broken into only two categories ("public" versus "private") and where "primary" 
is taken to mean "that source supplying 51% or morfe of person's total monthly 
support." 

Formula : - . ^ 

V 

% of 26' s with public assistance as primfltry source of support 

at follow-up I \ , - 

* % of 26 's with public assistance as primary source of support 
at closure 

Data Sources: ' * , ^ 



• RSA-300 

• Follow-up Survey (merge with RSA-300) 
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Data Element 7(iil): Percent non-competitively employed 26 closures retain^ 

ing closure skills ^t follow--up 

Rationale ; ^ 

Retention of functional and life status benefits is equally important 
as retention of vocational (i.e., monetary) benefits, particularly in the 
case of non- competitively employed 26 closures for whom non- vocational improve 
ment is the primary ''benefit*' derived from participation in VR. This data 
element "updates" the information provided by data element S(iii) , and will 
use the same FAX and LSI data items used for data element 5(iii)* Howevey, 
for the purposes of this data element, the FAX and LSX items will need to be 
modified into a form suitable for self-administration by the'clients, via- 
the Follow-up Survey. The specific items and their forms will be determined 
after completion of the FAI/LSX pretest. Until that time, data collection 
for data element 7(iii) would be deferred. Once implemented, the data element 
will have the following formula and data sources. 

Formula: 

# non-competitive 26 closuires retaining LSX/FAX closure skills 

# non-competitive 26 closures surveyed at follow-up 

Data Sources : 

• RSA-300 

• Follow-up Survey (merg^ with RSA-300) 
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STANDARD 8: CLIENTS SHALL BE SATISFIED WITH THE VOCATIONAL REHABILITATION 
PROGRAT-l, AND REHABILITATED CLIENTS SHALL APPRAISE VOCATIONAL 
, REHABILITATION SERVICES AS USEFUL IN ACHIEVING AND MAINTAINING 
THEIR VOCATIONAL OBJECTIVES . 

Data Elements: (i) Percent closed clients satisfied with overall 

VR experience s» 

(ii) Percent closed clients satisfied with specific 
aspects of VR 

(iii) Percent 26 closures jixdging services receiy^^^ 

to have been useful in obtaining tKeiif job/ 
homemaker situation or in current performance 

As an iii4ipa,tor of consumer appraisal of services, the standard on client 
satisfaction with vocational rehabilitation services has considerable merit* 
Since client satisfaction polls usually offer high degrees of support for the 
program, this standard i^ viewed as having distinct political value in lobby- 
ing for expanded financial support at both the state and federal level. Com- 
plementing the political utility of a satisfaction measure is the inclusion 
of a client utility assessment in the standard. The intent of this qlause is 
to ensure that successfully closed clients assess the utility of VR services 
positively in terms of actually having contributed to their getting a job and 
functioning in it. As a substantive rationale for the satisfaction standard, 
utility assessment offers a valuable entree for probing areas needing program 
improvement and for ensuring consumer involvement in improving the responsive- 
ness of VR services to client needs. 

Data Element 8(i): Percent closed clients satisfied with overall VR experience 
' Rationale ; 

As one of the data elements of the original nine standards, retaining 
overall satisfaction as a measure of program performance has several advantages 
(1) the procedure is in place; (2) developmental costs have already been 
absorbed; (3) it constitutes a composite measure of client satisfaction which 
responds to legislative and consumer advocacy concerns; and (4) the data show 
some discrimination among closure statuses. 
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Data Element 8(1) (continued) 
Formula : 

^ closed clients surveyed satisfied with overall VR experience 
__ # closed, clients surve yed _ 

Data Sources : ^ 

0 Closure Survey (merge with RSA-300) 
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Data Element 8fii): Percent closed clients satisfied with specific aspects 

of VR 

Rationale: 

: — y ' 



TMrs~dara element attempts to gain a more detailed picture of client 
satisfaction with specific key aspects of the overall VR process. In partic- 
ular, the aspects isolated for inquiry include questions about the client's 
couriselor, the physical restoration services received, the job training ser- 
vicers received, and the job placement process. Consistent negative assessment 

» 

in-a»v on^ of these areas would be highly useful in guiding state evaluations 
Formula : 

a. , # closed clients satisfied with their counselors 

# closed clients surveyed 

. b. ^ closed clients satisfied with phj^ical restoration services 
; # closed clients surveyed ^ 

c. f closed clients satisfied with job 'training services 

# closed, clients siurveyed [ 

d. # closed' clients satisfied with job placement services 

# closed clients' sua^eyed 

Data Sources: 

• Closyxe Survey (merge with RSA-300) 
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Data Element Sfiiil: Percent 26 closures judging services received to have 

been useful in obtaining their job/homemaker situation 
or in current performance 

Rationale : 

Rehabilitated clients can mak^ fairly objective assessments of whether 
the services they received were instrximental in securing their outcome situ- 
ations. Equally as important as VR services* contribution to the attainment 
of the client's closure situation-is the usefulness of the skills obtained 
in assisting clients to Sfunction in these new positions. While riot unequiv- 
ocably objective, the client's assessment of whether he/she uses these skills 
and/or knowledge gained/from VR services is the closest approximation of the 
case. 



s 



Formula: 



* 26 closures judging services received to^ave been useful in 
obtaining their jobyhomemaker situation or in current performance 
^ 26 closures surveyed 

• '■. . " 

Data Sources : 

• Closure Survey (merge with RSA-300) 
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COMPUTING THE' PERFORMANCE STANDARDS DATA ELBIENTS 

Having provided ^he reader with an overview of the Eerformance Standards 
and data elements, the next tasH is to provide the detailed information needed 
to access the required data and compute, the data elements. Table 3 serves 
this function. Reading from left to right, the table provide the foXlovfing 
information for each data element: . ' 

• the data element wording and the equation for computing the data 
•element; 

• definitions of terms used in the data element's equation; 

• the sources (i.e., documents, reports, or surveys) which provide 
the information needed to compute the data element; 

• the data specifications, which identify the location of the spec- 
ific information items used to compute the data element;^ and 

• a notation of the page numbers, in these Guidance Materials, where 
the data source appears. *The reader may refer to these pages for 
an illustration of the data sources and data items used. • * 

Table 3 should suffice as the general instructions on how to compute the 
data elements. However, there are two" additional points which must be made 
regarding the process of accessing data and computing the data elements: 

1. Merging of client surveys with client RSA-300 records : The client 
Closure and ppl low-up Surveys will need to be "merged** with the individual , 
/clients* RSA-300's. In the case of the Follow-up Survey, this is required 
so that comparisons may be piade between the client *s situation at closure 
(e.g., earnings level) and hisar her sitiaation at the point of follow-up. 
The data items using the Closure Survey do not i:equire any over-time compar- 
isons. However, the Closure Survey should be merged with the RSA-300 data 
record so that RSA and state agencies may have access to data on the client *s 
personal ch^acteristics ^d services provided* In this way, RSA and state 
agencies may conduct policy-related analysis when problems in performance 
a^ppear in the satisfaction/service utility data elements. For both the 



The reader must bear in mind that these locations may change as a 
result pf the revisions to RSA reports currently being undertaken in response 
to 0MB requirements. All the data items' will be retained after revision. 



ERLC 



62 



52 



Closure and the FolXow-up Survey, merging requires that a consistent' identi- 
fier appear bqth on the RSA-300 and on the Survey. The clienf-s case nmnber 
or Social Security number are the most logical -client identifiers to,use. 

"sing only "valid" cases to c ompute data elfem^nt. - Most of the dat/ 
elements for Standards 4-8 require input of client-level data. All calcula^ 
tions must be made using- only those cases for-which "legitimate"' data exist/ 
(i.e. . using only "valid" cases). This excludes .cases on which ciata are • 
"missing," because: 

0 

• the counselor could not obtain the information for ent^ on the 
RSA-300; . , 

• the client gave no response to a question on the surv,ey; ' 

• the client could riot remember or did not know the answer to a 
^ question on the survey; ar 

• the question was not appropriate to the client's circumstances 
(e.g., clients receiving no physical restoration services should 
not, be used to assess satisfaction with* physical restoration 
services).'' ;) . ' . 

For' most of the data elements using client-level data, the valid cases 
will determine the dendminator for the data, element. For example, data 
element 4(i) computes the percent of 26 closures earning the w. ekly minimum 
wage at closure. Assume that there are 1,000 26 closures, total; but that 
200 of those cases are missing data on earnings at 'closure (leaving 800 with ' 
"valid" data). Assume further that, of the 800 with valid data, 400 earned 
the weekly minimum wage at closure. Depending on the denominator used, the 
state agency's, pferformance on data element 4(i) wiMvvary: 

• using all 26 closures: 

400 . (# earning weekly minimum wage) 
4- 1000 (all 26 closures) - 
' = 40% ' 

• using only valid cases: 

400 earning weekly minimum wage) 

-r- 800 (26 closures^ with valid data) 
« 50% 
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Clearly-, in this case (and in.,eact.. in al^^cases. where a pfercehtage ' 
score is coniputed) a state agency's performance will appear' "better" when 
only vaa-id cases are /used for the." computation. Further, since we ^o not 
know the ti^e situation of clients for .whom data afe missing, we may. mis- 
takenly bias the score d9wnw4rd when .'including invklid/cases. (For example 
m the numerical example abo^e. the 200 cases with missing data may in fact 
have; been earning the weekly minimum. wage. Had .the d^ta been available the 
aged's scdre would have been' 60%. We must; however, assume that they were 
not. earning' the weekly minimum wage, if we wish to include them in the cal- 
culation.) In short, because we -wish to provide as accurate" a picture of, 
perfprmance. as .possible, based on the availahl. H... must compute the 
data elements- using only those cases for which all data exist; that is, the 
valid cases, ' ^ 
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, Table 3 

SiJMury, of Data Ele«ents» Definitions, and Data Specifications 
for the VR Prograa Performance Standards 

SFANDARD 1; VOCATIONAL REHABILITATION SHALL SERVE TliE HAXIUJH PROPORTION OF THE POTEWTlAtLY EUGIBIE TARGET 
POPUUTION, SUBJECT TO THE LEVEL OF FEDERAL PROGRAM FUNDING AND PRIORITIES AMONG-CtlENTS^ 



Data Eleaent and Equation 


Definitions 


Data Sources 


Data Specifications 


Page Reference 
for Data Source 


(i) Clients served per lOO^DDO 
popuUtioa: 

i served in a given year 


1 served « all active 'and 
closed cases (statuses lOOO) 
in the year* 


RSA - 113 
(Oct - Sept) 


II.A.3.a 


71 - 76 


state population (in lOO^OOOs), 


State population « current 
best proxy for "eligible 
population.*' Divide state 
population by 100,000 and 
truncate at two decimal 
points. 


U.S. Bureau of 
the Census « 
Current Population 
Reports « Series - 
P-2S 


State population estimate 
as of July 


96 


(ii) Percent severely disabled 
served: 

t severely d|nDed served 
in a given year 


1 severely disabled served « 
all active and closed 
severely disabled cases 
(statuses 10-30) in the year. 


RSA - 113 
(Oct - Sept) 


H,Ar3.b 


• 7i - 76 ' 


i served in a given year 


1 served «• saae as 1(1). 


RSA * 113 
(Oct •: Sept) 


n.A.3<a 


71 - 76 
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Tabic 3 (continued) * _ 

STANDARD 3: VR SHALL MAXIMIZE THE NUMBER AND PROPORTION OP CLIENTS ACCEPTED FOR SERVICES WIK) ARE 
SUCCESSFULLY REHABILITATED, SUBJECT TO THE MEETING OP OTHER STANDARDS . 



Data Element and Equation 


Definitions 


Data Sources 


Data Specifications 


Page Reference 
for Data Sources 


(i) Percent 26 closures: 
' 26 closures 


1 lb closures * 26 closures 
during fiscal year. 


RSA - 113 


II.A.4.a 


71 - 76 


f 26 ♦ 28 4 30 closures 


1 26 ♦ 28 ♦ 30 closures « 
total acceded clients closed 
(26 4 28 4 30) during fiscal 
year. 


RSA * 113 


lI.A.4.a 
t II. A. 5. a 
♦ II.A.6.a 


77 - 81 

i ■ 


(ii) Annual change in nuaber of 
26 closures: 


1 26 closures « current fiscal 
year. 


RSA - 113 
(current year) ' 


II.A.4.a 


^71 . 76 


('26 closures in current year) - 
('26 closures in previous year) 


1 26 closures^ previous fiscal 
year. 


- 113 
(pi'evious year) 


II.A.4.a 


71 - 76 



i 
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Table 3 (continued) 

STANOARO 4: REHABILITATEO CLIEffTS SHALL EVIOENCE ECONOMIC INOEPENOENCE. 



Data Element and Equation 


Definitions 


Oata Sources 


Oata Specifications 


Page Reference 
for Oata Sources 


(i) Percent 20 closures with weekly 
earnings at /above the federal 
Mininuii wage: 1^ 

1 26 closures with weekly 
earnings at/above the federal 
minimun wage 


Weekly earnings « earnings 
at closure. 

Weekly Miniaua wage s 35 
hours X hourly aininUM wage 
(BLS definition of full-tiMC 
eaploynent). ^ 

1 26 closures » closures 
during ^fiscal year. 


RSA - 300 

U.S. Bureau of the 
Census, Statisti- 
al Abstract of the 


Iten 4. J 

Federal hourly minimum wage 
Iten 4iP.2 


63 - 70 
94 

63 - 70 


1 26 closures 


U.S. 

RSA - 300 


(ii) Comparison o£ earnings of com- 
petitively employed 26 closures 

%u MX cniuiujrccs An inc 

state: 

Mean weekly earnings of cob- 
petitively employed 26*5 
Mean weekly earnings of en- 
ployees in the state 


Coapetitively employed 26s « 
wage and salaried workers 
(competitive labor ■arket}^ 
and self-eaployed (non-BEP). 

Mean weekly earnings « average 
earnings, week of closure, for 
conpetitive 26 closures. 

Employees in state ** produc- 
tion workers in Manufacturing 
industries. 


RSA - 300 

RSA - 300 

U.^. Bureau of the 
Census, Statisti- 
Abstract of the 


Itea 4.P.2 (26 closures); 
codes 1 and 3 on Item 4.1 
(conpetitiv.ely enployed) 

Itea 4. J (average) 

Labor Force, Enploynent, 
and Earnings: Production- 
Workers, Manufacturing 
Industries — 
Hours and Gross Earnings, 
by state, average Weekly 
earnings I 


63 - 70 

63-70 , 
95 


» 


U.S. 
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Table 3 (continued) 



STANUARJ) S. THERE SHALL BE HAXIWH PUCEMENT OF REHABILITATEO CLIENTS imO COfiPETlTlVE EMPLOYMENT . 

NON->CO»tPETlTlVE CLOSURES SHALL REPRESENT AN IMPROVEMENT IN GAINFUL ACTIVITY FOR TllE CLIENT. 



Oata Element and Equation 


Definitions 


Oata Sources 


Data Specifications 


Page Reference 
for Oata Source 


(i) Percent 2b closures competitively 
eR{¥loyed:-' 

* • competitively employed 265' 
1 26 closures 


f competitively employed « wage 
and salaried workers (competi- 
tive labor market), plus self- 
employed (non-BEP) . 

1 26 closures 


RSA-300 . 
RSA-300 ^ 


Codes 1 and 3 on Item 4.1 
/ 

Item 4. P. 2 


63 - 70 
63 - 70 


(ii) Pu^.cefit conpotitive-ly eaployed 
26 closures with hourly earnings 
at/ahovc the federal minl»u« wage: 

1 qonpctitivcly employed 26 
* closures with houlrly earnings 
at /above federal Bi>ilimun wage 


Hourly earnings « (weekly 
earnings at closure) 4* (' hours 
worked) . 

Hourly minimum wage 


RSA-30(i 

Statistical Ab> ' 
stract of the U.S. 


Item. 4. J (weekly earnings at 
closure); Item 4.M (' hours 
worked 9t closure) 

Federal hourly minimum wage 


63 - 70 

* ^\ 

94 


' competitively tm^ 


loyed 26s 

I 


f competitively employed 26s « 
some as 5(i) . 


RSA-300 


Codes 1 and 3 on Item 4.1; 
Item 4. P. 2 


63 - 70 


(ill) Percent iion-compet itively employed 
2.6 closures showing improvement in 
function and liferstatus (imple> 
neut after LSI/FAI pretest): 

' noii*compct itiVe 26s with 
improvement on l^l/FAl nneasuros 
from plan to closure 
1 non-competitive 26s 


Non-competitive 26s « 
sheltered workshop worker,* 
self-employed (BEP), home- 
makers, and unpaid family 
workers . 

Improvement on LSI/FAI « 
positive change on functional 
and status indicators; measures 
to be determined by pretest. 


RSA-300 * ' , 

R-300: 

acceptance 
• closure 


Item 4. P. 2 (26 closur^^s); 
Codes 2, 5, 5, and 6 on 
Item 4i»l (non-competitiVely 
employed) 

Jtem 2.V ^ 
Item 4.N 




^3 - 70 

63-70 
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Table 3 (cvnUoueJ) 



STANDARD 6; RaiABILITATED CLIENTS SHALL EVIDENCE VOCATIONAL GAINS. 



Data l-lcpcnt an J nquation 



(i) Average earnings change of 26 
^ cIo^ure:>, before versus after 
Vl^ services: 

(Siiis of closure earnings, for 26 
closures) ninus (Sun of referral 

earnings for 26 closures) 

' 26 clostires ^ * * 



(u) Other changes ,in functionaT 

ability and life status , 

(impiemcnt after LSI/FAI 
pretest) 



Definitions 



Stui of earnings for 26 
closures > total earnings for 
the group of 26 closures: 

• at closure « 

• at referral. 



126 closures « closures 
during current fiscal year. 



Change in functional ability 
and life status ■ same as 
5(iii); Measures to be 
deteniined by pretest. 



Data Sources 



RSA-300 
RSA-300 



RSA-300 



RSA-300:- 

• acceptance 

• closure 



Data Spe 



gtfications 



Itea 4. J (sun for all 26s) 
Iten 2,P (sura for all 26s) 

Iten 4'.P,2 



Iten 2.V 
Iten 4.N 



Page Reference 
for Data Source 



63 - 70 
63 - 70 



65 - 70 



63 - 70 



if ' 



\ 
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STANOARO 7: REIUBILITATED CLIEffTS SHALL RETAIN T1i£ BENEFITS OF VR SERVICES. 



Onii llcaent an J Equation 



Definitions 



Data Sources 



Uata Specificatiftps 



Page Reference 
for Uata Source 



(i) Percent 26 closures retaining 
earnings at follow-up: 

^ f of 2b closures with earnings 
at closure who retained or 
increased earnings at follow-up 
I 26 closures with earnings at 
closure, survc/ecl at follow-up 



Retained or, increased 
eatnings « cases where follow- 
up earnings are greater than 
%r equal to closure earnings. 



RSA-300 

Follow-up Survey 
(Merge with* R-300) 



Ite« 4.J (Weekly 
earnings , 

Question 3 (Keek 
at follow-up) 



Closure 



earnings 



ff 26 closures with earnings 
at closure • cases Vhere 
weekly closure earnings are 
greater than zero. 



RSA-300 



Ite« 4.F.2 (26 closures) 

Ite» 4. J (Weekly closure 
earnings)' 



Only 26 closures are surveyed 
at follow-up. 



63 - 70 



88 - 91 



63* - 70 



(ii) Comparison of 26 closures with 
. public assistance as primary 
source of :»u|)port at closure 
and at follow-up: 

% 26 closures with public 
assistance as primary source 

of support at follow -up 

% 26 closures with public 
assi:»tancc as prinary source 
of support at closure 



Public assistance as primary 
source of support » cases 
where SSI, SSDl, AFDC, GA, 
Workmeti's Cotipensation, and 
public institutions account 
(singly or in combination) for 
more than S0% of a person's 
total monthly support: 

• at follow-up 

• at closure. 



FoUow-up Survey 
(Merge with R-300) 

RSA-300 



Questions 2, 3, 4: 

Q.2 4- (Q.2 % (Q.3x4) ♦ Q.*<) 

Item 4.N.1 



26 closures (Only 26 closures 
are suiVeyed at follow-up). 



RSA-300 



Item 4. P. 2 



(ill) Percent non»co»pcti i i vrly 

employed 2(* closures retain- 
ing closure ^fT]lls at follow- 
up (implement after LSi/FAI 
pretest): 

f non-comfict 1 tive 26 closures 
retaining LSI/FAl closure skills 
i non-competitive 26^ stn^eyed 
at fol tow-up 



Non-compet L-tive closures » 
sheltered workshop worker, 
self-employed (BEP) , home- 
makers, and unpaid family 
workers. 



RSA-3D0 



Item 4. P. 2 (26 closures); 
Codes 2, A, S, and 6 on 
Item 4.1 (non-conpetitively 
employed) 



Retailing closure skills > 
equal or greater score on 
functional and status - 
indicators at follow-up^ 
compared to closure: ' 

• closure (measures to be 
determined by pretest) 

• follow-up (L"^nsures tp be 
determined by pretest). 



RSA-30.0 (closure 
section) 

Follow-up Survey 
(Merge with^R-3C.O 



Item 4.N 
Question 5 



88 - 91 
63 - 70 
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STANDARD 8: CLIEKTS SHALL BE SATISFIED HIW THE VR PROGRAM^ AND REItABaiTATED CLIEKTS SHALL APPRAISE 



VR SERVICES AS USEFUL IN AailEVlNG AND MAINTAINING THEIR VOCATIONAL OBJECTIVES 



■ Data £iciQcnt*and Equation 


Def initions 


Data Soiirras 


Data Sncci cat i one 


Page Reference 

for Data Sonrrt» 


1 (i) Tcrccnt closet! clients satisfied 

■ ^ with overall VR experience. 

1 ' closed clients surveyed satis- 

■ ficd with overfill VR ^experience 
I * closed clients surveyed 


Closed^clients * 26, 28, and 
3d closures (Closure survey 
given only to 26, 28, and 30 
closures). 


Closure Survey 
(Merge with R-300) 


J 
\ 

Question 1 (all respondents) 


82 - 87 


I (ii) Percent closed Clients satisfied 

I with specific aspects of VR: 

B ' closed clients satisfied with 
H specific aspects of VR 
1^1 closed clients survoyod 

II (four equations) 


Closed clients » 26, 28, and 
30 closures* 

Specific aspects * satisfied/ 
not satisfietl with counselor, 

Dhvsicsl restoration cArvi ri»c 

job training services, job 
placeaent services. 


Closure Survey 
(flerge with R<300) 


Questions 2 < 8 
(All respondents) 


82 - 87 


1 (ni) Percent 26 closures ^udginf 
1 services received to have been 
I useful in obtaining their job/ 
1 \ honemuLer situation or in cur- 
1 Vrciit performance: 

Y 26 closures judging services 
iwjceiVcd to-^havc'^fieen useful 
ii) obtaining their job/hone* 
Riker situation or in current 
perforaaiice 

.A 26 closures surveyed 


Closure Status " 26* 

Useful " ^'useful in helping 
get or perfoVa in" the 
person's closure occupation. • 


RSA-3aO^ 

Closure Survey 
(Merge with R-300^ 


Ite» 4. P. 2 

Question. 9 (26 closures 
only) 

/ 


63 - 70 
82 - 87 
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DATA SOURCES FOR THE PERFORMANCE STANDARDS 

In the following sections, each of the data sources for the Perform- 
ance Standards are disciissed. For each source, we present an example of 
the source (i.e,, the report, survey^, or document); the standards data ^ 
elements for which it is used; and, when necessary, instructions for impl 
menting the data collection. 



63 



< 



THE REVISED RSA-500 * ' 

The evaluation of the VR program is based, to a large extent, on 
the data submitted by state agencies to RSA on form OHD-RSA 300, The 
R-300 data, as it is called, contains information recorded by the voca- 
tional rehabilitation counselor on each client's characteristics, history 
with the program and several other programs, work situation and income 
prior to and after receiving rehabilitation services* The purposes of 
collecting this information are to: 

(1) measure the effectiveness of the VR program at the national 
and stat^ levels; ^ 

(2) describe the operations of the program 'to the President, 



(5) provide specific' answers to questions raised on operation 

of .the prograui* ' ' . // • 

The original R-300 form consisted of three different parts, each of 
which was designed to collect information about the. client at a different 
phase of the rehabilitation process: 

• Part 1 — to, be recorded kt the time of the first referral; 

• Part 2 — to be recorded at completion ^ the referraj^process; and 

• Part 3 — to be' recorded at the time of closure. 

The data requirements of the Standards necessitated the creation of 
an additional section (containing three new items) , which in the revised ' 
R-300 is labeled "Part 3 to be recorded at the completion of the IWRP." 
IVhat was originally Part 3 is now labeled Part 4 and contains three 
additional items. Two new items ^have also been added to 'Part 2. No 
changes were made in Part 1. The new items have been added to the R-300 
to, facilitate the collection of data that mpre accurately portray client 
^ob status and benefits incurred as a result of the VR process. Below 
we introduce each new item that has been added to the R-300. 



• (4) 



C3) 



Congress, and state legislators; 

disseminate data on the characteristics ^of clients in the 
VR program; * 

provide data on the operations and effectiveness of the 
program to various public^ and private organizations inter- 
ested in the vocational rehabilitation of the handicapped; 
and 




Additions to* Part 2; Coc/pletion of R<?ferral Protess 



•Tvfo n^w data items are added to Part 2. However ;^n^ of these — 
the Functional Assessment and Life Status Indicators -r ^ill not be Added 
until after completion of the FAI/LSI pretest • In addition to the ,tW8^ 
new items, states are urged to include an item on their R-300 equivalent 
for entering the name and address of friend or relatlvrT>f the client. 

Item U: Federal.Special Program Identification / 



None 


•TF 


VET 




MAW 


PO 


WIN 


SEC4 


SF 


SD • 


Sum 






* 


















000 


001 


Q02 


•004- 


010 


020 


040 


100 


200 1 


400 





DirectiPR^ ^ Insert an "X" within each box for each federal special 
program groiip with Which the individu3.1 was identified, and enter in the ^ 
"Sum" box the sum of the codes for the boxes marked with ah "X". i,?0T 
codtt definitions , see. RS Manual.) ^ 



Item V: FAI/LSI 'Indicators ' ^ 

When the pretest of the Functional Assessment Iriventory and Life Status 
Indicator items is complete, the items chosen for use in assessing function 
and, status will be/input on the R-300. Function and life status be 
assessed at acceptance and at closure. ' The "scores" at ^icceptance will 
appear in Item V. - ^ ' 

^ ^ For State R>500 Equivalent Only: Address of Friend or Relative ' 

This iteift is not used specifically to compute any data elements.* How- 
ever, it potentially could be very helpful in boosting respbn$e rates' tOt 
.j:he pollow^up Sxirvey, as well a? in keeping contact\with jslients in service 
,^tatta|es. however, it^/{sn<Dt necessary or desirable for this information' 
\o, be! included on the R-^OO input data sent to RSA.^ Instead, individual , 
state agencies aVe encouraged to include this information bti; the*1l-300 ^ 
equi val ent . C>|t^y • 
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New Section 3: Information to be Recorded at Completion of the IWRP 

. This section actually will be used to address one of the Procedural 
Standards, discussed later in these Guidance Materials. The new Part 3 
of the R-300 pertains to the original IWRP.. Three items are included: 
date IWRP completed, work, status of original IWRP goal, and original .occu- 
pational goal. The 'Voxk status." item is used in the Procedural Standards, 
The date of IWRP completion is useful to have on the R-3G0, both to verify 
the Case Record and to calculate the months^a client is in Status 10. The 
occupational goal is useful to hkve as a cross-check on work status of the 
goal and to inform managers of the range of occupatioi^al goals made by 
clients and counselor's. These items must be filled out at the point of 
completing the original IWRP. ' . * ' 

Iteni A: Date IWRP Completed 

Directions : Record the date that the client's originstl IWRP was given 
final approval. The date should be tlie same as thjs date the client moved 
from Status 10 (Plan Development) to Status 12 ! (Plan Completed) . 



Item B; Work Status of Original IWRP Goal\ 

' Dire^ions, : Record the iMie-digit number indicating the work status 
of the original IWRP goal-j^using the same codes as, for Item 2.0 (Work 
Status at Referral). Do not use codes 7-9 or Y for Item 3.B. 



Item C: Original Occupational Goal 

Directions : Record four digit code from the Dictionary of Occupational 
Titles for th^ vocational^ job goal listed in the original IWRP. ^ 

Additions to Part 4; Closjure' from VR . ^ " • . 

Three new items are^added to Part 4 of the .R-300: numbAof hours ♦ 



worked the week ^ clpsure; primary source of support at closure; and 
functional and life status at closure. 'All are used to compute Performance 



Standards data elements. 
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Item M; Ntanber of Hotirs Worked During Week of Clostire 

Directions : The counselor will need to determine th^ number of hours 
the client worked at his or her job during the week of closure. Because 
this information will be used to compute the client's hourly wage, the 
"week" referenced here must be the same as the week usedVor Item 4. J 
(Weekly Earnings at Closure) . Simply enter the number of n^iurs worked in 
Item 4.M. 

.Item N: ^Erimary Source of Support 

Directions : The counselor wjil need to determine whether the client 
derives more than half of his or her total support from public or from pri- 
vate sources. To do this, the- counselor must: 

(1) determine all sources of support, and the amoxmt each 
Source contributes;, 

(2) add together the amount contributed by each public source 
to determine total public support; 

(3) repeat Step 2 for the siam of private sources of support; 

(4) check the box in Item 4.N which corresponds to the larger 
amount between Steps 2 and 3. The larger amoxmt is, by 

J' 

definition, greater than 50% of the. total support (represented 
by the sum . of Steps 2 and 3). If the sources split 50% pi:^lic . 
and 50% private} code Item 4.N ''private.*' 

"Public sources" consist of the following: - - ^ 

• SSI, 

• SSDI, 

• APDC, 

• General Assistance (GA3,( 

• Workmen's Compensation,* and 

• iSiax-supported public institutions. 

Item 4.S: FAI/LSI Indicators * ' ' 

This item, when implemented after the FAI/LSI pretest ,^will give in- 
formation at point of case closure corresponding to the acceptance infor- 
mation recorded in Item 2.V. 
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Uses of the RSA>3Q0 Data for Performance Standards 

Exhibit 1 presents^ an* example of the revised RSA-300 form, and the 
instinictions for completing the form. The reader can refer to Exhibit 1 
when scanning Table 4, which shows the uses of R-300 data; in computing the 
Perfprmance Standards data elements and Procedural Sttodard 13 (goal- 
• occupation match) . ^ 
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* 

Table 4 

Uses of R-500 Data for Performance Standards 



"R-300 Item.^ 


Used in Data Elements:^ 


Keterrai aaue ' 


2[lllJ , 2(.1VJ 


l.E,: Age at referral 


"J f A A A \ f A 

2(;iii>, 2(;ivj 


i . r . o6X 


f A A A '\ f A %^r'\ 

2(.iiiJ , 2(.ivj 


2. J: Previous closure 'from VR 


2(iii); 2(iv) 


2.0: Work status at referral 


2Ciii) , 2Civj 


2.P; Weekly earnings at referral 


2Ciii), 2(iv), 6(i) . 


2.V: FAI/LSI at acceptance 


S(iii), 6Cii) 


3.B; Work status or IWRP goal 


Procedural Standard 13 


4. A: Closure date 


2(iii), 2(iv) 


4.E.1: Total case service costs 


2(iii), 2(iv) 


4.1; Work status at closure 


2(i)/2(iii), 2(iv), 4(ii),.5(i)- * 
(iii) , 7(iii) , Procedural Standard 
13 ' , 


4. J; Earnings at closure 


Hiix), 2(iv), 4(.ij, 4(ii), 5(ii), 


4.M. Number of hours worked 
during week of closure 


S(ii) 


4.N: Primary source of support 
^t closure 


7(ii) 


4.0.2: Months in status 10-24 


2(iiiO , 2(ivO - 


4.P:* Closure status 


2(i)-Civ, 4Ci), 4(ii), 5(i)-(iii), 
6(i), 6Cii), 7(i)-(iii), 8(i)-Ciii), 
Procedural Standard 13 


4.S: FAI/LSI at closure 


SCiii), 6(ii), 7(iii) 



a 

Column entries show standard number and data element number. The stan- 
dards using RSA-300 data, and their broad foci, are: 



6: Client change 

7: Retention 

8: Satisfaction 

13: Goal -occupation match 
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2: Cost-effectiveness and 

benefit-cost 
4: ' Economic independence 
S: Gainful- activity 



ERJC 
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Exhibit L 
Revised R-300 Form 
tStandards input data' is shaded) 



Case VuiMr^ 
A. Use fa* 



CASE SERVICE tEroTT: STATE-f EOEIUL PHOOUX Of ^-OCATiaNAI. tCHAilLITATIOJ* 
FAKT t (TO te ^ECOtPEP AT TIME OF ^^TStCVFJ^KAL) 



Inicul 



\33rissl Strttc and Nusbvr 



County 



F33¥^i ; 

ATT : (TO IE K8C0I 



C% 'K«^«rr«4- Dace 



0. Referral Source " 



bisaOilur as RtfqrcH (a«scriM) 

£if Com " 



Soc. S«c. 'to- 

SSOl Scacut 

Scactu ....... 

Met 0 . . . 

Datt t«f«rral 

Months iB Statuses 00-OZ 



tF CLOSED FROM STATUS 00 . CCMfLETE PAKT 4. 
tF ClOSEP FKOH STATUS Qz /cOWUTE ITEMS 2.1. 

fliW 2^T. AN6 fAj^T4. 

tF ACCEfTED FOR EXTEHQEP gVAUiATlON OK VK 

imxtii . Cfln»UT£ IT&tj tmku I.t. 

DO NOT COHPL£TS PAJIT 4 AT T1IIS TIME. 



Assistance 
(inclurfinc SSI) 



b 

Ant. J_ 

c TiiM 
on ^.A. 



SfaAisJi SunaM: iQy«s:2Qko 
OutcM* of Xaftrral Procass: 
VOX ACCEmP : Haason * 
I □ fr«« (00) ; 2 □ fro« (02) 

ACCEmO FOR: * 

04 □ SxttnM Evaluation (0«) 

05 Q VX Sarricas (10) 

Oijaklinf CaiWitlMa (4MC7lk«) 
1. Mtjor 



S. Prlaaiy Sourct of 

Support 
T, Typa of Institution . . 
U. Feteral Special Profrajt 
Idtntification* 



: : . : : w:Q:t: riii-oincui*; .-^w; Q:: 
III.'.:!! claaiiic 1.1 1.1 ^ I ^ : i I • mill:: • 



.Nona 






1 






5ft f 5t',*i 
















<Mo 
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T Sacanrfatr" 



t. Marital Sutus . . . ^ 

L. NM^r of Dtpan^nu. . 

M. Tt>tai NwMr in )Faallr 

N. Hightst Gra^ Canyiattd ^ 

:a: i )(bit: s utui «::::::;:;:, 
'.ii ; )Mit:e4«(^: ;: ; : ; :^ ■. 

q. T^tai Mnthlx Family 
IncoM (ijteluiing 
tamincs) 



: I y.i : Fii/csc ihii«t«i :>::::::: 
:::::: {toiw »«w»ioetJi ::::::::: 



fhXt \ {Mi ife KEliOKP^P AT COHPtETION OF THE IWUP) 

A. Pata IW co^lattrf ■ • 

C, Original Occupational Coal (TITLE) 



: .^'i' '•?.'9*.?*?*f?*:: ; :ti* ** — : . :. . 

a. ftafirrrt^ by S«c^ Sac. A*iiH. *; * ' i *Q Ho;" Yai 
S«<.lsl Sacuritr Clala Trf* • . • * 



C. 
0. 



Fadaral Saacial Prograli Idantification* 



Nona 












WIN 


^S£C« 


5r 




Sua 






































TOT 


m 


■3M 





\m i t^ro « AKfl*6ffl XT Tim 6p cLaajjgF : 

. ii(< 1 {}utca»a .of k«(a«M:EuaiuatiM:6r .IOC siWUtsi ::::'.::::: 
' : : : : : liQcidiMC nM:u(<iuc«c Evtioittcu :csx>ttt«:(in xiumi:^ 

I i : : i i:di«<««< ^ihiii i< iistim i w: i : i : i :::::::::::: : 
: : I : : g- Q- .H?r: M*!*^^^^?****: (?*»^ X*?* :■ i i :i : **^*?:i 

q. Sarvlcas ?r«vi4a4: 



: r.: : coit :«< C5i?^: jf rr wws: :::::::,:::.:::::::::: 


:::XP9U«»x:::::. 


2. ftahabtlitation Facilitias - Total ^ 




3. Social Sacurity Trust Funds - Tatai 




4. Sunltfltntal Sacurity Incaka 'F^m4a * Tatal 





F. Pata Ext. Eval. CoiipUta<l (4f applieakla) t 

C, 5S0I Status ,.*..,..' ; . *. . i' 

H, SSI, Status. 

I» ikark ^tMual ♦* 1 * I w '. *. j • » ' i •.- . . ;. | » . 

»r.. faulty Eajrnii>c» ...:...*.* * I J s .^J. 

X. Public Asststanca J Typa 

(including SSI) (^Honthly Aaount S_ 

L. Occupation (titla) 



9:' 



Coda_ 

?«\ji» a r of'Hourt -«^kad'0«rtnc *tali*af qiosvra\.| .; , . , 
^rtsary ^«ca Suppaft:. l.Qp»ki*V- private 

I. In Satandad Evaluation (Status 04) . . 

\ fra«.AccaptaAca. U-CIoiur* (Sfcatusaa [10-24). . '^ \ . 

3. in Traininf (Statu* U) ........ 

4. Itaady Par ar tn tm^loftmnt (Statuses 20-22) . . . 



Typa of Sarvica Provida4 
or A|TaAgad for by Agtncy 


Cost 
Status 


10 Piagnostic and Evaluation 




11 Kastoration *f Physic a l.ai" Hantal) 




12 


T 
K 


Collaga or Univarsity 




13 


Othar Acadcflic (Elca. or HS) 




14 


A 


lusinass School or Collaga 




IS 


I 
H 


Vocational School 




16 


I 

H 
C 


On>tha*Job 




n 


Personal Voc. Adjustaant 








Miscalloneous 




td'^tatntenance 




:o 


Othar Sarvtces 




21 


Servtcas to Othar Faaily Mamba.'s 





• No sarvica 

i Nith agency 
cost only 

> Without ' 
agency cost 
only 

• Ni;^ and 
without 
agency tost 



n. State Agancy SMcial Progrta Identification* 



Sona i < 






i I \ 1 . { 2U« 


\ 1 1 






1 : 1 1 




tPU4 







5. FM/tSl (mHcaters'tto Irr deteniinetf): 



0.-fte of 'Report 



Ci»unsctor Signature 



ERIC 



* Tlieta ice«« are t« M ceded: 
CASC Fflt COPY 



pistnct CeOe * 
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Exhibit 1 (continued) * . 

(Asterisk indicates standards input data) 



CODE ItST FPU POtM $>tS-«SA'30O 



A|Mcr Co4« - (S«0 RS »UAual) 

rirt 1 etc* f " Countr Cod* 

enctr Cha chr«« ^ifit do4« fro* th« co4« list provU*^ 
by yout aftncy 

fart 1 Itm 0 - JUMrral Sourct Cod*s 
(I.) Educational In;timions 
10 Colltc« T uAtvcrstty (insticuctoa offtring* hi|h*r than 

steondary education) 
12 Vocaci«nal setwol (including busiii«ss» cradt. and athtr 

ctchnical) 
U Eleatncary or high school 

U Scho«l for Ch« phyvteallf' or MRtaUy hMdicappad 

19 OtJitr •dticactonai tnsticuCioM 

(2.0 Hospitals aM.Sjpitarmw» > 

20 H«fttal hosptcai 

22 othtr chronic eondittoM sp*claiiz«4 hospical 

or 5tftitarluis 
24 C«n«rai h«spical •» 

29 Othtr Kospical tr clinic (axctpc ptAlic hMlth clinic) 

(3.) Httlth Organizations and Af ncus 

30 lUhab. Fac titty (txctpc CoMunity Mtnfat Maith Canttr) 
52 CoNMjnijey «^ncal Kaalth Canctr 
34 Statt Crippltd Cbildrtn's Aftney 

31 OtiMr public htaith dtpartamc, org«nimioii« or agtncy 
(including puklic hMith nurso ai cilntc) 

39 Othtr privact haclth trtaniucloii or a^ tncy 

(4.) wlfar* Aj^ncioi ' 

40 Public ««ittr« agvncy (stato m4 lacal ftvtmaMt) 
44 Private Ml far* af*iicy 

(S.) Pufclic OrtinimiOTa «4 AK«ci*s • 
Soclai S*€urtty OUabiUty D*t*rmn*t1iii«t 
Social S«cinicy District Offlc* * 
M*Tfca*ii*s Ct*HMation Ag*iicy (f*4«r*l m4 stau) 
Stat* Eafl*yMftt S*rvic* 
S«l*etiv* S*tYic* Syst*« 
Stat* Vo^tional itohabili cation Agvney 
Corrvctionai institution, court* or officer 
OtJi*r public •Tgtnixatloii or agnicy (not sp*cificaily 
tducation. h*«lth or v*lfar*) 
■ (*;) friTat* Ornaitations «nd Ai*nci*» 
Artificial *pflianz» CM^any 
€afloy*r (privat*) 

Oth*r priyat* orgaaixatiafi or agvnc* (n*t tp«cificsily 
•ducatioft, h*d(th or Mvifsr*) 

(7.) IndividoaN^ 
S«tf«r*t*rT*d p*rsoii 
Phyflici*ji» n.*.e. 
Oth*r individualt. ••*.€. 



Pa^ 1 It** C . Oliability as lt«p*rt*4 (S— RS Maaoal) 

Part 2 It*M f aa4 C md part 4 lt*M G aad H - SSOI and 35X Sutus 

0 Kot aa applicant 

1 Applicant - AIlow*4 bMMfits 

2 Applicant - 0*nl*d b*iMfits 

3 Applicant - Status of appiicstioa panding 

4 Nat knavit if an appiiJ»a« (Da not us* In part 2 It*M • 

an4 C if acc«pt*4 for CC vr Vft sarvicas. Oo not us* 
in Part 3 Itana C and H if closad in status 

5 lanafits discantinuaA ar taninatad 



Part 2 Ita* 0 - Itaca 

1 Wiita___ 



3 Iniiam 



Y Mat availabia 



2 Mgr* 



4 Other 



*Part 2 It*« H m4 part 4 It** P • ftaasan for a*sitr* 

1 Unsibia, t* loeata or contact; or aovad 

2 Handicap too s«v*r* or unfavvnbl* Mdicat pmnatis - 

3 Rafusad sarvicas ar futhar sarvicas 

4 Oastb 

5 Cliant institutionalizad 

k Transf*r to anothor agancy 
7 Failur* t* cooptrat* 

g Ho disabling condition (closurts fron 00 or Oi only) 
9 ta vocational handicap (closurss fitM 00 and 02 only) 
Y Othar 

Part 2 Itni I - Disabling Conditions (S«« RS Hanual) 

I 

Maritai Status 



Psrt 2 Ittit 0» Part 3 Ita* f , and Part * Iten ( (continued) 
CP NOT >(Sg Tire FOILOWIKG COOES AT PLAH COHPICTIQH . 
OR AT CLOSUKg FOR STATUS 2k CLOSURES 
7 Kot tforfcing - stu^ant 
f Not Marking - athor 

9 Train** or worfcar (noii*co«^titiv* labor aarfcat) 
Y Not svailabia 

Part 2 IteaQ • Haathly Faaily Inc*a* (including *amings) 



S 0.00 
JISO.OO 
J20O.00 
5250.00 
S300.00 
S3S0.00 ' 



149.99 
199.99 
249.99 
299.99 
349.99 
399.99 



J400^00 . 449.99 
J4S0.00 - 499.99 
5500. 00 • 599.99 
5600.00 and over 
Not availabl* 



Part 2 It*« R and Part 4 its^ K • Typ*Lof Public Assistanc* 

0 Son* (D* not us* at elosur* if clitnt r*c*iv*d PA 

b*ti#**n r*f*rr«l and closur*. S** cod* 9.) 

1 SSI - ag*d 
: SSI * blind 

3 SSI - disablad 
« 4 Aid to fuiiias with dcp«ndant children (AFDC) 
5 C«nanl asststaaca (GA) only 
( AFX and SSI in coabinatian 
7 (Do not use) 
f Typ«(s) net Icnown 

9 PA r*c*iv*d b*tw**n r*f*rral and closur* only. (Do 

not us* in Part 2 it** R. R*cord dollar aaaunt 

af first diack.) 
Y Nat availabia (Da iMt us« in part 2 Ita* R if acc*pta4 

for EE or VR sarvicas. 0* nat usa ia Part 3 Ita* X 

if clas*d in status 2t.) 



Part 2 It** R - Tim on PiAlic Assistanc* 
0 Not r*c*iving public assistanc* 
t Uss than six aonths 
. 2 Six aonths but lass than on* 
r*ar 

3 Ona year but tass than tw* 

4 Two years but lass than thr*« 

Part 2 It** S • Priaary Soure* af Support 



thr*« yasrs but 
Uss than four 

Faur years but 
less than five 

Five yosrs or oor* 

Not available 



Part 2 I tea K 

1 Marrted 

2 ¥ido«ed 

3 Divorced 



4 separated 

5 Never aarried 
Y Net avatlabie 



Part Z rtea 0. part 3 rtea 1. and Par^ 4 rte* I « ^•rt Status 

4 wage ar salaried worker - coepetitiv* labor aarfcat 

2 Kage af satarted marker - shelter*^ werkshep 

9 Setr*e»pley*^ (except lEP) 

4 State*4gency-«anage4 business* enterprise (ICf) 

5 t(*«e«aler 

t Unpaid faatly werker 



00 Current earnings > interest, dividends, rent 

01 Faaily and friends 

02 Private r*ii*f agvncy 

03 Public assistanc*, at least partly with f*d*nl finds 

04 Public assistanca, without f*d«ral finds (CA only) 

05 Public institution - ux supportod 

04 M*rka*n;s conp*nsation 

07 Seciai Security Disability Insuranc* b*o*fits 

Of Ail oth«r public sources y 

09 Annuity er other non4isabiUty insurance benefits 

(private) 

10 All other sources o£ support 
YY Not svailabl* 

Part 2 It** T - Type of Institution* ' . 

00 Not ia institution at r*f*rrai 

01 Ptiblic a*ntaf hospital ^ 

02 Privat* a*nt*i hospital 

05 Psychiatric inpationt mit of g*n«rai hospital 

04 Coaaunity asntal h*alth c*nt*r • tnpati*nt 

05 Public institution for th* nentally retard*^ 

' 04 Private Institution for th* a*ntally r*tard«d 

07 Alcohol isn troatnoat c*ntar 

Of Orug abuse trvataant center 

09 School and othar institution for the blind 

10 School and other Institution for th* d*af 

11 General hospital 

12 Hospital or specialized facility for chronic illness 

13 Institution for th* ag*d * 

14 Halfway hous* 

15 Correctional institution • adult 

Ik Corr*ctional institutton • juvonil* 

17 Oth*r institutiOhs and living arrangcaents 

Part 2 Iten U and part ^ Iten 0 - Federal Special Pragraa 
Identification (See RS mnuai) 

Part 3 Iten C • Original Occupational Coal (See Dictionary of 
Occupational Titles • OQT) 

Part 4 !ten C • Social Security Clain Tyro ^Se* RS Manual) 

1 DIf 3 COI-OI 

2 CDt*0A 4 (Wl 
9 No trust funds *xpenditur*s 

Part * Ite* L • Occufiation (See R5 Manual) 

t 

Part 4 Ite* N - prinary 5*urc* of Support fentor cod* f*r soure* 
supplytnf SO) or ^or* of total support) 



So 
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THE RSA-113 QUARTERLY CIMJI^T WE ' CASEI^AD/EXPENDIIUR^^^ 



The.RSA-113 report is a new form developed by RSA to replace the 
RSA-101 and RSA-2. At the present time, the RSA-113 contributes only , 
caseload data for computing the Standards. After final revision, the 
RSA-H3 will also contain the financial data needed for the Standards, 
Table 5 shows, the standatds data elements using RSA-113 data. An exampl 
RSA-113 form appears in Exhibit 2, with the standards input data shaded. 
(This version of the form was current as of July 28, 1981.) 
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, Table 5 , . 

Uses of RSA-1X3 Dat a for Performance Standards 
, * 



' RSA-il3 Item ^ 


Usdd.in Data Elem/nt: 


I. A* 6"! a C# 08 from 00/02) 


2Ciii), 2(iV) (benefit-cost)^ 


I.B.S.a C# 08 from 06) 


'"^ ' h 

2(iii), 2Civ) Cbenef\t-cpst) 


II. A, 3. a (# available) 


l(i), l(ii) .(coverage)^ 


II.A.S.b S.D. available) 


l(ii) (cpve'rage)^ 


II. A. 4. a (# 26 closures) 


^b 

2 (ii) (cost-effectiveness) , 
2Ciii), 2Civ) (benefit-cost) [ ^ 
3(1), 3(ii) (rehabilitation rate) 


II.A.S.a (# 28 closures) 


2(iii), 2(iv) (benefit-cost) 
3(i) (rehabilitation rate)° 


II.A.6.a (# 30 closures) 


2(iii), 2(iv) (benefit-cost)^ 
3(i) (rehabilitation rate)° 



^As of 7/28/81 

'^Focus of relevant st;^dard 



/ 

/ 




/ 



S2 



8ttU k Aseflcy_ 



QMARTtntY CWULATIVI CAfiELOAP/CXFgMDITURK REPOHT 
Blind 

C«ner*i fUc^l Year 19 



Qaartcr 



rArf 



LINK 



CASCUU> ^ 



2, «Ue« on I 



3. »»«U>>U DurUg Nrtoj (M t *?) 



^. *<coU4 for V» tUc^ OctX 



1. p» Oct I 



2. f u<t Oct I 



3. il.«IUfcU Mmk Nrto4 (It ♦ i?) 



- Ace»yt#4 fof Vy > >t.U< Oi 



4. »t>«UUf EM Qtr (M . ill - 



TOTAL - 
ALL CASES 



CtATUSfJ I0.3Q ) 



A ACTIVf CAaCtOM) 1. Ol» lUM Oct X 



a. B«w iUc« Oct X- 




TOTAL - 
SEVERe CASES 



SSOl 
c 



SSI 



' 15 — ^ 

^ J^J^ I^ CAiMca. tt«U coImmi It for tNi4«ii*t|e»lt4 tiiUU tt4 Mitt ^« fftAl ^ tfM Uma r««f««liv« •t Mlt Ml m»4 tMlt *if9*ri f«tMM« 



• BASIC 
SUPPORT 



SEVERE 



NON- 
SEVERE 




C/) 



(A 

p 



Q 
P' 



I? 



pa 

O 
H 
rt 
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•M^ Of ISOI, 531. •a4 ktte Support coIima«. ««f«»»" 
••port ittfetc^cnt riicU V««r pr*J«cttoii« only m tlft fMrUr-tiMttlMi ' 



— n — 

' ( ) Blina ' 

8UU & Agency / \ General / 




• 


Placal Year 19. 




• QuactOK* 


~~~ — ^ k 

PAi*^ SECTION rryc 


TOTAL - 
ALL CASES • 

a 


TOTAL - 
SEVERE CASES 

b 


SSDI 

6 


ssi- 


BASIC 
SUP^RT 
• NOM- 
SEVERE SEVERE 


111. r*O«CTl0t? A. IST1MA10) I. U9t% Qu4rtfr 












Mtnci or f 

itruAtiLiTAnoits 

2. »M«|M«r of rifMt Utr 












yscAL rtAji ' Ti T iTxz 






■» 







2. |l«Mr U N itlukniUto4 






















FEPURAL PROPERTY 


NON-FEDERAL PROPERTY 














: — 3, r«<iittt» f ciM*4 







to ^ 
n* 

§ 
g 



Patt 



CERTIFICATION 
thla report U coMpXet* and corrtot. 

gigned , 
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ERIC 




la 



ntoQiuus/f MictioNS/ACTfvnm ► 



C t^m ft9fnm Irvctnt* ttWH> 



4 l<M•v1Uyvl^br•rrtf«<M 



'•'Support 



1. 



X 



r 
1 



'X. 



■utusorjuNM 



W SSI 



X 



Tin Of lull * 

k Mil ' 



MM 



4. WM. $MOimt 



_i ' - - 



«ft ik« »MfOMt Ml Unk k lh« awMtf 



in 



f {CHATUMC or AUYHORUCD ccufinriHa 
orriciAt ^ 



ivrco oi rtuHifo hauc ako tiiic 
X 



icnu 



X. 



X 



X 



X' 
X 
X 



pAU MfHlfir 
SuftUilUO 



X. EHTRIE3 MADE BY STATE AGENCY 



O H- 
O O* 

rt rt 



3 Ni 




8t 



OMD No, 1^20-003.3 
Expires Dec 31, 19fl2 



12. REMARKS: AddenduAi 

^/ Estimated Federal Fund Requirements \ to end of fiscal year for: 



(1) Basic Support Program, 
(i) Trust Fund Program 
(3) S.fJ.I* Program 



b. 



Estimate of fiftate Matching S^mds available 
in the subsequent Fiscal Year for Basic 
Supper t . Program 



J 



m 

X 

cr 



O 
O 



THE ANNUAL REPORT FOR VOCATIONAL- REHABILITATION' 

/» 

The- RSA-2 report has been discontinued by RSA as -a reporting require- 
ment for state agencies. However, we include the RSA-2 in these Guidance 
Materials because, as of this writing, the RSA-2 is the only currently or 
formerly used report containing certain financial data items needed for 
the Performance Standards. The new RSA-113 will, after final revision, 
contain the necessary information. Thus, the RSA-2 is included solely, to 
show the specific data items needed; ultimately, these data items^ill 
come from the RSA- 113. 

Table 6 shows the uses of RSA-2 data for the Performance Standards. 
The data is used only in the cost-effectiveness and benefitrcost data 
elements. Exhibit 3 presents an example RSA-2, with the standards input 
data shaded. ^ 



78 

Uses of RSA-2 Data for Performance Standards 



RSA-2 Item 


Use in Data Element: ' 


II.B.l.D CSect. 110 maintenance 
service costs) 


2(iii), 2(iv) ■ . 


1 1 . D . 1 . D (Trust Fund maintenance 
servide costs) 


2(iii)-, 2(iv) 


II.F.l.D (SSI maintenance ser- ' 
vice costs) 


2(iii), 2(iv) 

/ 


II.B.i.H (Sect* liu total ser- 
vice costs) 


2(111), 2(iv) . 


II.D.l.H (Trust Fund total ser- 
vices-costs) 


2(iii), 2(iV) 


JI.F.l.H ^(SSI^total service 
cost^) 


2(iii), 2(iv) • 


III.C.8 (Total 'Sect. 110 program 
costs) ' ' 


2(i), 2(ii) • 


IV. 4 (Trust Fund, SSI) l> 


2(i), 2(ii) 


V.C.7 (I § E total costs)'' 
ill ' - ^ 


2(i), ^(ii) • . ' • ' 



^SA-2 data is used solely .for the cost-effectiveness data elements 
[2(1) and (ii)] or the benefit-cost data eleiapnts ['2(iii) and fiv)] 



^rf relevant to current program operations. 
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STATE OF 
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Exhibit 3 
Example RSA 2 
(Standards input data is shaded) - 

DEPARTMENT OF HEALTH. EDUCATION. AND WELFARE 
REHABILITATION SERVICES ADMINISTRATION^ 
WASHINGTON. D.C: . 

ANNUAL REPORT FOR VOCATIONAL REHABILITATION 

^ GENERAL [* ] BLINQ f T 

FOR FISCAL YEAR BEGINNING 19_ AND ENDING 



Foftn Approved 
No: ,83'-R?)0l7 



PApT I Number o/ Persons Rohabilitatcd; 

S«v«r«Iy Disabled 
- Non-Severoiy Disabled 
Total 



BASIC SUPP. 



6 

TRUST PUNOS 



C 

SSI FUMOS 



Total 



PART \\ ObU%zUcn% fur Services for f 
» . IndivtduiiU ^"^-^ 

° . N 


A 


a 


c 


0*. 


£ 


F 


'OSLI0A1 

seci 

tSA'^IC 


'IONS Ft^OM 
'ION MO 
Stlf PORT) 


OaLK ATIONS P'ROM 
SOCIAL SECURITY 
TRUST FUNOS 


OBLIOAT 
SUPPLEM6N 
INCOME 


IONS FROM 
TAL SCCOmTV 
PROGRAM 


(Includ* cmih and ceniltrd dist>urt*m»nci «i)d 
unlt^utrfAtiid obttftiioftt ) ^ ^ 


CUttNTS 


AMOUNT 


NO, OP 
CL.ICNT3 


AMOUNT 


NO. OP 

cuicnts 


AMOUNT 


t S«fvtc«t for Individuals 

A DiMcnotllc and Cvalutl'jn ^' 














B. R« »iof at ion (Phytic •! ' « McntaO 
<1) Surc«ry-and Tre^mmi 








4 






(2) Prosihettc and Orthotic A^pli^nctft 














(Jl Hospital and 'Convalescent Car* 














(4) Othvr Rratorytton 






V 


t 

^^^.^^ 






(S) Totat R«acoratton^ 














C. Tratatnc 

(I) C»lle^^ or Unirersity 












4 — 


(2) Other Academic (EUmaniary or Hifh School) 














(3) Buainaaa School or Coll*c* 














(4) Vocational School' 






• 








l5J 0«^h« Job 














^4) personal and Vocniionut Adiuaimrfnt ^ 














(7> MiacaHanaout ^ 














(t) Total Traininc 














D. Maintrnanc* 












C. 5ervicr;a co Kamity Member* 












1 ' ' ' 

F. Po«c ivrnployment Safvic»> 














C. Other Services 






* * 


— 






H. Total Services for InJividusls 






— 








2.^ CUssiticatiun oi Oblitfulions by Type*' Vendor 
A Umt9 Agency Operuteit Krh.iU. K^ciliiies 








• 






H Oth^r R<h.ihtlifjiion l-^cilitics 


h 










C. Other Vendors 










i 




0. Tor*l 














i. OMiCMtions fur Ksi^nde^l EvwI. (St^iius 06) 















lERlC 



CERTIFICATE " 
This f^cport xH Complete and Corrucr 



Owie 



SIfned 



Aufhort^eci ^ignMiur* 



80 



.Exhibit 3 (continued) 

STATE OF 



2 of 4 



GENERA 1, IlI.lND QJ 



PART ill ObIif(««tians From Scrtion 1 10 of Rehabilitation Act ^ 

7- Ti. , , , 


OStlGATiONS' 




TMIRO PAr*TY 


STA rE vri 

AGENC V 


TOTAt CERTIFIED ' 
AND AGENCY 


1. Aflmiri^istrMCion 








2.' Coun»*linc anU'PtMrrmeni * 








i. 'S*fTic«s for tnitlviiluulji 








4. Smstt Bu«ih*tt Enrrrpns** 








5. EatKblisbmenf of Rrhah ' K>ciltlt*s ' 








6. Fte. snri Services to Groups o/ (ndiviiiuals « 








7. Afancy Oprrsiad Rsh^t;. Fac. (Cap. Expend.) 






f 










T«ial 








9. Federal SharW 








THE AGENCY'S SHARE OF THE AMOU.NT 
REQOIRED UNDER THE MAINTENANCE OF 
EFFORT PROVISION. S 


10. State Share 


\ 


V 




1,1. Construction Costs* 








IZ» Federal Share ^ T» 










13. State Sh^re ^ 








14. Total Federal Share ' 








IS* Total Stafe Share 









' * e» : 

PART IV Summary of Oblif^ations and Allowances in Lieu of Direct Charges 
ffom Social Security Trust Funds and SSX Program 




TRUST FUNO 






t/ 

/ ^ 


F 


/ ^ 


F 


^ ^. Admintsiration 














2« CoUnselinc end Pt.ncemrnt ^ 














3^ Services for Individuals 














4. Toiat Obltc^sctons ind Allo'.vances 












■aii 



^ Indicate with a check mar^ the amo^int entered was by the Time Records method (T/R) or Formula mcthod<F). 



ERIC 



PART V Obligations From'Scction 120 of the Rchabtt^j^tion Act 

s 


OBLIGATIONS 


TOTAt CERTIFIED 
AND AGENCY 


ThiRO OA n t y 


4T A Tfe V« 
* A CCNC Y 


1. Ailmint sCfalion , ^ * . 








2< Coun^rlitiK und Ptucrmcnt 








J. 5rri'ic-rs for tn.iividuiil s . ^ 








4. 5m«^ll riusinrts Foirrprnes^ * 








5. Fsiobtifhfl^nc of f^rh.*l>. Kuktitiir. ^ 








4. Fhc. and Servtcea |o Crou<vs af IndivtiluuN * 
• 




1 






y 










• 7. Taial » 








• - ' ... t« KaUrral Shura 








*V. State Share , 






4] 
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Exhibit 3 (continued) 












Pagc3of4fiCC^ 


STATE OF . 




GiCNKRAL 


1 ni.iND r 1 






* 


A 


8 


\ c 


0 


E 






•SECTION 110^ 










PART VI Vocational Rehabilitation Personnel 
Equivaient Man Years 


THIRD PARTY 


STATE OVR 


SS OfS. 
BENCr. 


SSI 


ALU OTHERS 


TOTAL 


MAM YCAAS 


MAN YCARS 


MAN YCAMS 


MAN YCAAS 


MAN YCAAS 


MAN YCAAS 


t. Ad4itinisira(i«o 




1 1 


r— 1 








2« C«uns«tinK Mid Rl)«c«m«tic (a) Cou{ia«lora 














(b> Oihar 














i. Sarvieaa for Indtvtduala 














4. Staff at Sc. Ooar. R«hi«h. Fac fa> Counaalora 














fb) Oihar 














5. T«cat 













PART VII Establishment o/ Vocational 
Rehabtlttation Facilities 

Mame and Location 



Teml 



ESTABLISHMENT OF VOCATIONAL REHABILITATION FACILITIES 



CAPACITY 



incrcasco to 



TOTAL OBLIGATIONS 



PART VIII Construction of Vocational 
Rehabilitation Kactlities 


CONSTRUCTION OF VOCATIONAL REHABILITATION FACILITIES 


e 




c 


A 


CAPACITY 


TOTAL OBLIGATIONS 


f*Amr und Locution "* 


prcscn t 


iNC^CASCo ro 


• 
















w * * ' 

^ Toinl 




:05 . ^ 


- — . ^ 


r^-^^^ . -' , ■ — 
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THE CLIENT CLOSURE SURVEY 

The Vocational Rehabilitation Performance Standards require that VR 
clients be satisfied with the services and training receivecTand that the 
services are xiseful, in obtaining and performing jobs." In the past; VR 
agencies have gathered information addressing such issues through the use 
of follow-up questionnaire surveys. How;5ver, a review of th^ VR Program 
Evaluation Standards noted many criticisms of this effort, including .non- 
comparable sampling designs, survey forma^ts, definitions, and resulting 
data across states,. high nonresponse rates, and reporting biases.^ The ^ 
Closure Survey (and the Follow-up Survey described later) is designed to 
replace the unsatisfactory ad hoc operations with a new approach, stan- 
dardized across state agencies. 

The Closure Survey is intended for distribution at case closure to 

2 

a sample of clients whose services are terminating. As a self-completion 
mailback questionnaire, it is designed to be self-explsmatory and to be 
completed by the clients themselves, the Closure Survey will serve as the 
sole source of client satisfaction data (for all closure types) and of 
data on service utility '(for successfully rehabilitated clients). 

Exhibit 4 presents an example of the Closure Survey, complete with 
column numbers (for computer keypunching) and response categories. Table, 
7 shows how the Closure Survey data will be xised in computing Performance 
Standards data elements • 

Two points must be noted regarding the Closure Survey. First, as 
stated earlier, the Closure Survey was designed solely to address the 
standard on client satisfactioa. However, at the state agency's option, 
it may include questions on income, etc., if. the ag^cy desires^f-to use 
the survey' as? a validation procedure for its R-300 data.' As well, the 
state, for i^tjs own purposes, may include other- questions (for example., 
questions asking whether the client or someone else completed the survey, 



^Berkeley Planning Associates; VR Program Evaluation Standards: A 
'Critique of the State of the Art, ; January 7, 1977; RSA Contract' #105-76-4116, 

* 4* 

2 • 

^ A sample of SOO clients (300 - 26 closures, 100 - 28^ closures, and 
100 - 30 closures) is adequate for the purposes af the ^standards. The 
clients should be sampled throughout the fiscal year, rather than sampling 
ali respondents from a particular fiscal quarter or monthj^ ' . ^ 



r 
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> Table 7 - T 

Uses of Closure Survey Data for Performance Standards 

4 



Closure Suryey Question:. 


Used' in Data Element: 


X 


o\^ij (^t^rcenx or cuoseu ciieuLS saLis — 
fieU with overall VR expei^iencej 


2 


8(ii) (Percent of closed clients satis- 
fied with their counselors) 


3, 4 


8(ii) (Percent of closed clients re- 
ceiving physical restoration 
services, who *are satisfied with 
those services) . 




o (,11 J (^rercenr ox pxoseu cxiencs re^ 

ceiving job t;raining services, » 
who are satisfiedj^ith those 
services) 


. . 7, 8 

— — ^ 


8(ii) (Percent of closed clients re- 
ceiving* job placement services,, 
who are satisfied with those ^ 
services) 




8(iii) (Percent of 26 closures judging 
* services received to have been 
useful in obtaining their job/ 
homemaker situation or in current 
performance) 


4 

J ' • 

\ 




V 
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Exhibit 4 
Client Closure Survey 



(Column #) 
(1-3) 
(4) 
(S-14) 



(If) 



(16) 



(17) 



Questionnaire No. I I I I <^ 
/_/ '-(Card Number) « . ' ' . 
I I 1 .1 I I I L I LI (Client I.D.f 

VR CLIENT CLOSURE SURVEY 

^ 7 

1. Are you satisfied' with your overall experience 
wi-th the rehabilitation program?. [PLEASE CHECK 
ONE] 

s^i. Yes 

2. ,No ^ 

9. Not sure or no opinion 

2. Are you satisfied with your counselor's per- 
formance (that ,is> did he/she do a good job 
for you)? [PLEASE CHFCK ONE] 

1. Yes , ' ■ 

2. No 

9. Not sure or no opinion 

3. Did your counselor arrange for you to have 
Physical restoration services ., such as medical 

• ^treatment^ physical therapy^ artificial limbs> 
eyeglasse^> dentures^ hearing aids> etc.? 
[PLEASE CHECK ONE] - - 

1. Yes 

2. No 

• 9. I don't remember 



as 
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Exhibit 4 (continued) 



'(Column #) 



(1&) 



(19) 



(20) 



(21) 



(22) 



^, If YES. are you satisifed with these ser- 
vices? [PLEASE CHECK ONE] \ , 

1. Yes - 

2. ^^o' 

■ 9. Not sure or no opinion 

5. Did your counselor arrange for you to have 
job training ? [PLEASE Ci^ECK ONE] 

1. Yes 

2. No 

9- I don't remember 

6. If YES. -are you satisfied with the ^cind of 
training you received? [PLEASE CHECK ONE] 
1. Yes 

2. No ■ ' , . ^ 

9.\ Not sure or no opinion 

". Did your counselor help you look for a job? 
[PLEASE CHECK ONE] 

• I 1. Yes 

2. No 

9. I 4on't remember 

8. If YES. are^you satisfied with the help you 
received? [PLEASE CHECK ONE] .. 

1. Yes 

2. No' ^ . 

9/ Not sure or no opinion 
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Exhibit 4 (continued^ 



(Column #) 



(23) 



S. Were the services or training yo^ received 
( from tfie rehabilitation program useful in 
, helping .ypu to perform Th your'present situ- 
ation or^in helping you get it? [PLEASE 
CHECK ONE] 

1. Yes 

: 2. No 

3. I received no services or training 

/ from the rehabilitation program 
9. I have no opinion 



J 
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how long it 'took to complete the survey, and whether Rirther services are 
desired), Howpver, all state agencies miist iise the exact wording and 
oi:der for, those questions used to address Standard 8; any other questions 
jnust be appended to the core, set of questions for that standard, 

. The second point concerns merging ^of the Closure Surveys with ijhe 
clients* records. By merging Closure Survey data to the R-300 data 
(on client characteristics, services received, and service outcomes), the 
Closure Survey can be used to help identify strengths and weaknesses of 
specific counselors "and service ^strategies. 




iiJi 
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THE CLIENT FOLLOW-UP SURVEY 

The Per.formance Standards mandate that "rehabilitate'd clients shall 
retain the benefits of VR services." The Client Follow-up Survey provides 
all data on retention of benefits. This dat^ is used both for the reten- 
tion standard (#7) and in the benefit-cost data elements (Standard 2) . ^ 

The Closure and Follow-up Surveys differ in focus: the Closure Survey 
measures client satisfaction, while the Follow-Up Survey measures benefit 
retention. Beyond this, however, the two surveys havfe many jJarallels.- First, 
the Follov-Up Survey is also designed as a mailback questionna^ire, sent to 
a sample of former clients (sent one year after closure from VR) . However, 
the Survey is sent only to rehaMlitated clients (i.e., 26 closures) on the 
theory that benefit retention is relevant only for rehabilitated clients. 
A sample of 200 - 26 closures is adequate for the purposes of the standards. 
As with the Closure" Survey, clients should be sampled throughout the fiscal 
year.' This requires that some Follow-][ip Surveys be sent out each month, 
as close as possible to the point one year after closure from VR. The 200 
clients sampled tor follow-up need not 6e part of the Closure Survey sample. 
However, overlapping the two samples will reduce sampling effort and afford 
a more complete data base for use in investigating performance problems. 

A second parallel is that, like tjie Closure Survey, the Follow-f.p 
Survey is intended to provide'^tan^ardized data across all state agfencies. 
Thus, while^state agencies may add other questions ttTthe Follow-up* Survey 
as they wxsh, all states rmSt use the exact wording' and order for the 
'.questions used to addr^ess 'Standards 2 and 7; additional questions must 
be appended to the core stt used for the standards. - 

Finally,^ the Follow- tip Survey must be mergeU with the sampled clients' 
R-30oVrecords, to allow measurement of benefit retention between closure 
and follow-up. As well, mer^ng allows for investigation -of performance 
problems. 

Table 8 shows the tises^of Follow-up Survey data in computing Perfof- 
'mance Standards data elements. An example Follow-up Survey is presented, 
iiy Exhibit S, including column numbers and response categories. The table * 
and exhibit also note that additional questions (pertaining to functional 
abilp.ties and life status) will' be added to the Follow-up Survey after 
completion\)f the pretest df the Functional Assessment Inventory (FAI) 



and Life Statxis Indicators instrtmient (LSI) . , 

ErJc , V , i02 



\ 

• Table 8 



Uses of Fpllow-Up Survey Data for Performance Standards 



Fol low-Up Survey Question: 


Used in Data Element: ' 


1 < 

• • 


(Update ^n work'statios. Not used 
* explicitly for standards*) 


* 

2' 


:7(ii) , (Primary source of sutppoil^^t) 


3 


2(iii), 

2(iv) (Benefit-cosx) 

7(i) (Earnings retention) 

7(ii) (Primary source if support) 


■ 4 , 


7(ii) (Primary source of support) 




7(iii) (Retention of functional 
abilities and life status) 



Questions to be added after pretest of Functional Assessment 
Inventory (FAX) and Life Status Indicators (LSI). 



r 
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I ^ Exhibit S v 

Client Follow-Up Survey 



(Coltmm #) 
^ (1-3) 
• (4) 
(5-14) 



CIS) 



(16-19) 



Qiies^ionnqiTB No. ////// 
/_/ (Card Number) \ ' " \ ' 
1111,1 /./ I I J I- (Client I. DO 



. VR CLIENT FOLLOW-UP SURVEY ' - 

1. ^Which of the foHowing statements best de- 
'scribes you^" present work situation? [PLEASE 
CHECK "only ONE] . ♦ 

1. I earn, a wage ,or salary^ either at a 

V regular job or from^self-employment 

2. I earn a wage or salary in a sheltered 

worl^hop'or Business Enterprise Pro-, 
gram ;CBEP) 

3'. I am a homemaker 

■ 4. I work in a family -farm. or busl'it^ss 

without pay 

5. I am -not working at present 

6. Othel- (explain): ' ■ 



.How much total income^ if any^>did you .and 
your dependents receive last morfth from all 
sources of public welfare? [PLEASE CHECK ■ 
ONLY. ONE AND FILL IN THE SPACE] 

_ ^ We received $ last month 

" None^ \ 



r don't remember^ 



104 



91 



Exhibit S (continued) 




3. Wfiat were your total earnings last week (from 
ajoti. self-lmployment. sheltered workshop, 
or Business Enterprise "Program (to)?' 

• _^ I earned $ last week 

' I am working" but I don't receive a 

wage or salary ^' 

I am not .working^- 

I don't know^ 

4. -♦•What, was your inc^m6 last month from private 

sources other than the earnings reported in 
Question 3 (for example, from rents, divi- 
dends, or private insurance)? 

I received $ last month 

' None^ > . ^ ■ 

I don't remember^ 



5. (Items assessing functional ability and life 
status; items to be determined through pre- 
test -of Functional Assjeseqient Inventory (FAI)^. 
and Life Status Indicators instrument (LSI). 



^These responses will require multicolunm codes (e.g., 0000 for "None" 
on Question 2, 9999 for "I don't remember" on question 2). 
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"EXOGENOUS" DATA SOURCES; U.S. CENSUS -PUBLICATIONS 

In addition to the program reports and cli^t surveys, the Performance 
Standards also require data from recurrent Censios Bureau repprts* 'This 
data will be obtained by RSA and input to the MIS for computing the data 
elements* Two Census, docments are used: the annual Statistical Atystract 
of the United States , and the annual Current Population Report, Series 25 
Table 9 lists the documents, .data items used, and standards data elements 
using the exogenous data. Exhibits 6, 7, and 8 give examples of the input 
documentation , < , 
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Table 9. 

Uses of Exogenous Data for Performance Standards 
U,S, CensTis* Bureau Recurring Reports 



J 


Document 


Data Item 


Used in Data Element: 


Statistical Abstract 
of the United States 


Federal hourly 
miniroum wage 


4(i) (Weekly minimum wage) 
S(ii) (Hourly minimum wage) 




Average weekly 
earnings of 
manufacturing 
production 
workers* 


4(ii) (Comparison oi client 
earnings to state wage 
.norms) 


Current Population 
Reports, Series P-25 


Current estir 
mate of state 
population 


l(i) - (Coverage of eligible 
population) 






• 


• 

• 




- • 






* 


« 








I 
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Exhibit 6 ^ ' . 

Statist jlcal Abstract ot the United States : ^ . ^ 

' Soiirce of Minimum Wa g6 Data 
^ ^— ^— ^— 

(Used in data elements 4(1) and 5(ii). Shading denotes Standards input data.) 



No. 689. Effective and Scheduled Federal Minimum Hourly Wage Rates, 1950 
TO 1981, AND Coverage in 1977 

fKmployete3timate$tsors«t<«mbtri9r7*ttcepta3^ndicaucl.Tbt Fair Labor Standards Acto( 193t«ndsubM« 
quenc ^endibents to 1977 providl for minimuni watt coversft to b« txtanded to s0eciOed nonsuptrvisory 
cmplovtn^nt catetoriw. Eieropt from covcrogo trt esecutires and adminatraton or professionals | 



■Kcnrt 



Jan. ^1950. 
Mar. U 19M. 
3tPt.3,1061, 
Sept. J. 1903, 
Feb. 1. 1M7. 
Feb. 1, IWt. 
Fab. U 19#9. 

Feb. 1, 1870. 
Ftb. 1, 1971. 
May 1» 1974. 
Jan.M973.. 
' Jun. 1.1978.. 
Jan. 1. 1U77.. 
Jan. t.a97S.. 

Famra ratea> 

Jan. 1.197V.- 
J4n. 1. 1JR».. 
Jon. 1. 1961.. 



Nontum workers 



Xaws 
pnor 
■to« 

-IMtt 



% .7S 

1. -00 

3iS 

1:60 

Id): 
■(»)• 

2. -00 

i>;iD 

■(*)• 

•3i36 



Per- 
cent 
ayf. 

earn* 
logs* 



M 
• S2 
SO 
SI 
SO 
54 

4« 
4« 
4« 

'•43 



19W 

and 
later* 



(X) 
(XI 
(X) 
(X) 
91.00 
l.lS 

.1.x 

1.45 

i.eo 

1.90 
2.00 
2.20 
2.30 
2.63 

2.90 
3.10 
3.3S 



Farm 
work- 
ers* 



<x) 

(X) 
(X) 
(X) 

$1.00 
i.is 

1.30 

(0- 

O 

1.60 

l.M 

2.00 

2.20 

2.65 

2.90 
3.10 
3.35 



SEX, RACE, AND 



Tetal.. 



.Male, 

Female................* 

White 

Black and other. 

Block on)/ .....^ 

Prlrai* ladiMCry 

Aitrfcttiture 

Mlninx...^ 

Constniction........... 

Manafoqurtnic.I 

Transp.^-pUbMc util.... 
WhoI«w# trade........ 

Retail trjUe . 

Finance, ins.* real estate. 

Service ..... 

Prime households 

Qov^;ramcnt » , 



KOKsoPEtYisoitr exnoYXES, 1977 



Total 
(1.000) 



7t.Ml 



41.070 
29,731 

62*343 
S.55i 
7,t21 

<1.51i 

1,431 
763 

3.740 
17.«1« 

4.124 

3.790 
12.645 

3.896 
11.600 

l.«94 

9i291 



Subject to mioimum races 



Total 

ilJOOO) 



54.446 



31.969 
22.477 

47.7S5 
6.661 
6.111 

ium 

565 
7W 
3.720 
17.146 
4.052 
3.039 
9.871 
2.960 
8.557 
1.315 

2.553 



Pe^ 

cent 
or 
total 



76.9 



77.8 
75.8 

76.8 
77.8 
78.1 

84.4 

39.5 
99.5 
90.5 
97.3 
96.3 
80. 0 
78.1 
76.2 
73.8 
64.1 
27.5 



Prior 

to 
1M6> 

(1.000) 



38.634 



34.614 
14,020 

34.560 
4.074 
3.738 

38.634 

, 730 
3.039 

17.045 
3.956 
2.926 
4.756 
2.856 
3.297 



; 1»66 

and 
laur 
Amend- 
ments * 
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after hrpt. 1965. to workers covered Uy 1961 Amcrdmenu. Rotes set by 1961 Amendments weo*: Sept: 196I.S1.00: 
•Sept. l'J64. $1.15; ami Sepc^965. 51.25. * Per mt of cmas artraco hottrly cammcs of production workers in 
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emntoycu workers subjeet to criteria In etfcct prior to 1966 Amendments. • Currently employed workers 
subject to provisions. ' No chanie in rau. • Preliminary. • Federal. SUta. and Jocal employees. 
■ >V>urc«: U.S. Dopanment of Labor. Employment Standardt^d ministration. Minimum irafeen^ Maximum 
llourf atMMUrds Undtr Uu F%ir Ubqr SUndMrdt Act, 1978^ 



2SS«S00 O - Tt • ^9 



Reprinted from U.S. Bureau of the Census, Statistical \Abstract of 
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) Rcprcacnu \VM»hinBton. U.C.. StomUnl MptropoUtan Statistical Area; data not comparable prior to 1075 dut 
to chafiM in arc:! drnnitiqu. 
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i^rcc: V.S: Horetd of Lolwr StAtlttlct. £mpl$9m€ni 9h4 E*tnin9$, monthly. Compiled from dau supplied 
by cooperaUnt fitatc u«ct{clcs. ' jSk 



^Reprinted from U.S. Bureau of the Census, Statisticral Abstract of tho . 
United Sta$e§, 1978, page 424. 
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• ' U.S. Census Current .PopulationNiteports . Series P-25 : 
^ Source of State Ptfpujration Estimates 
(Used in data element ICi). Shading denotes ^andards input data.)" 
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Reprinted from U.S. Bureau of the Census, Current Population Reports , 
Series P-25, 1977, page 11; 
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■III. GUIDE TO THE PROCEDURAL .STANQARDS SYSTEM 

The Procedural Standards consist of five goal-statements for the VR 

program ;>pertaining to R-300 validity, corapliante With key regulations, 

' and certain aspects of case handling. The wording of^the^tandards is 

^ as follows^ y 

4 Procedural Standards 

9. Information collected on clients by the R-300 and all data 
reporting systems used by RSA^shall be vali<f, ^reliable, 
accurate, and complete. ^ 

10. Eligibility decisions shall be based on accurate and suf- 
ficient diagnos'tic information, and VR shall, continually 
review and evaluate eligibility decisions to ensure that^ 
decisions are being* made in accordance with /laws and 
regulations, r / 

11. VR shall ensure that eligibility decisions and client 

» movement through the VR process occur in a timely manner 
appropmate to the needs and capabilj^fries of the clients. 

12. VR shal^ provide an Individualized Written Rehabilitation 
Program for each applicable client, and VR and the client 
shall be accountable to each other for complying with this 
agreement. ^ , v, 

13. Counselors .shall make an effort to set ^realistic goals for 
clients, Compx'eHensive consideration mtist be given to all 
factors in developing appropriate vocational goals such, 
that there is a maximum of correspondence between goals and 
outcomes: competitive goals should have competitive outcomes 
and noncoippetitive goals should have noncompetitive outcomes. 

^ • The Procedural Standards will b^ reported for a given state agency 
every third fiscal year, RSA will conduct the data collection and will 
report the results to each state, agency. The data elements for ttie Pro- 
cedural Standards consist of a number of individual information items 
pertaining to various aspects *of the particular issues addressed by a 
given Procedural Standard. (For example, the eligibility -standard in- 
cludes data elements on the process follov^d in declaring applicants ineli- 
gible, as well as data element^ on the process followed for "eligible 
applicants.) Thus, RSA'and state agency program managers will J)e presented 
with information on "how ^things are done" in the agency, with respect to 
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€he key processes .embodied in the Procedural Standards. It is intended 
for states to usf the Procedural Standards to benefit thei^rogram eva^- 
ation efforts ancl facilitate the improvement of services to clients* 
The information obtained via the Procedural Standards will form the basis 
for agency decisions to makfe appropriate changes in practices, where 
Current processes are not in keeping with client interests and positive 
program performance. ^ 

The methodology for implementing the Procedural Standards reflects 
t^ desire *to allow maximum flexibility *to states in the VR process, yet 
s^ll ensure attention to the are^ addressed by the Procedural Standards 
and provide sufficient data in these areas to allow for program-wide analy- 
sis. Ideally, a uniform procedure would be followed by all states for 
monitoring these process areas, even though states retain differences in 
the ways they organize and conduct case service delivery. Indicators of , 
compliance with legal requirements, such as eligibility and IWR?, shodld 
be the same for all states; that is, the same questions should be asked ^ 
and the same^ficnmary data should be reported. 

Most of tM needs- .of the Procedural Standards are best met through 
case review. Thus,^ a single case review process will be implemented to 
address the case review needs of four of the Procedural Standards. This 
process will use the Case Review Schedule (CR$) , developed by the San 
biego State RCEP IX, as the basic document for Procedural Standards data 
collection. The CRS 'has already been mandated by RSA as the standardized 
^nstrment to be used by regional RSA offices whenever they conduct case 
reviews. For Procedural Standards 10 (eligibility) and 12 (IWRP), the 
CRS items essential to adequately assess compliance have been selected. 
Tl^se items make up the Modified CRS, which is considerably shorter than 
the full CRS. RSA could chdose either the CRS or the MCRS as the instru- 
ment for collecting Procedural Standards data. 

While the CRS, is an appropriate vehicle for collecting compliance 
data, it lacks certain items needed to assess the validity of R-SQQ data 
(Standard 9) or to assess timeliness of case service (Standard 11). For 
these standards, twd separate instriflnents have been, developed to complement 
the CRS. These two instruments are incorporat^ed directly into the CRS to 
provide a unified data collection instrument. ^ 
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Finally, sVandard 13 on the correspondej^ce between IW^ occupational 

goals and final outcome uses data fr6m the R-300- Mhe R-300 items have ^ 

been. noted earlier (see pp»\ 63-70). * ^ * y 

^ Jo suamnarize, th€ Procedural Standards consist df five process^ 

oriented goal-statfments for the VR program* For Standards 9-{2^ data 

collection will occur in a given state agency, every third year. RSA will 

•conduct the case reviews needed for data collection. Standard 13 uses % 

R-300 data, and could be reported annually- Harving described the g^exal 

thrust of the -Procedural Standards .and the general process for collecting 

the needed data, we turn next ta 'a discussion of the individual standards. 

Following this, we present a summary of the data sources and data items/* 

usec^to compute the Procedural" Standards. Finally, we present the Case 

Rei^w Schedule (including R-300 and timeliness .assessment sections) and 

« 

ins.tructions for collecting the data. 

■ u ■ ■ ■ ^ 
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THE FIVE PROCEDURAL STANDARDS 

STANDARD 9: R-300 VALIDITY^ 

Information collectg4 pji clients by the R-30Q an4 all 
da ta reporting systems used by RSA shal-1 be valjiT ] 
reliable, accurayte, ^nd completed ' 

The VR service delivery systems needs an objective data base from 
which to measure performance • Yet inconsistencies and errrfraj^ reporting 
currently exist among and within VR program data Systems. Confusion or 
misunderstanding oVer de^Tiiti6ns exist and need to be minimized. This 
Procedural Standard would ensure that statis agencies maintain acceptable 
levels of validity and reliability in reporting of R:-300^nd other data. 
This standard assumes states' attention to good data processing is perti- 
nent to^l the standards. Thus, given the iii5)ortance of, reliable, valid, 
and accurate data on which to base the program's evaluation capacity, this 
Procedural Standard relates -teethe broad RSA goals of compliance, ciuality, 
and cost-effectiveness, * 

Reliability, accuracy and completeness of data could be checked in 
several ^rays . / While a' state agency could conduct; validity studies on a 
•periodic basis, and edit checks as a part df routine' data processing, this 
standard encompasses a specific recommended procedure for state^ to follow 
to ensure the accuracy of d£tta recorded and submitted to RSA through the 
R-300. Primarily, the case review process includes an accurag^ check be- 
tween the case "folder information, the .R-300 lEorm Itself, and, if the 
state has a computer system, computer output listing of R-300 items selected 
for reyiew. In particular, those R-300 data iliems which are- xised in com- 
puting the standard's data elements are subjC</ted 'to checks .of accuracy 
and validity through case folder documentatioip*^ 

- This standard tises the R-300 Verification Instrument (Section I.C 
f the Modified Case Review Schedule, presented below) as the data source • 
able 10 shows the R-300 items which are checked using the R-300 Verifi- 
cation Instrument. 
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Tablfe 10 



R-300 Items Checked Using the R-300 Verification Instrument' 



Referral date ' 
Closure date 
Social Security nijmber 
SSDI status at referral 
SSI status at referral 
Major (primary) disabling condition 
Secondary disability 
Work status at referral 
Earnings the week prior to referral 



Reqpipt or nonreceipt of public 
'assistance at referral 

Type(s) of public assistance te- 
ceived at .referral (SSDI, SSI- 
Aged, SSI-Blind, SSI-Disabled, 
AFDC, Other) 

Monthly amount of public assistance 
received' at referral 

Length of txi'e, prior to referral > 
diiring which the client received 
public aj^istance 

Appropriateness of the Federal 
Special Program Identification 
checks (TF^Vet, MAW, PO, WIN, 
SEC4, SF, SD) 

SSDI status at closure 

SSI status at closiare 

Work status at closure 

Weekly earnings at closure 

Receipt^'^Or nonreceipt of public 
assistance at cld^^ure 

Type(s) of public assistance re- 
ceived at closure (SSDI, -SSI- 
Aged, SSI-Blind, SSI-Disablef, 
AFDC, Other) 



Monthly amount of public assistanqje 
i^eived at closure ^ 

Occupation at closure ^ ^ 

DOT code for that occupation 

Outcome status (08,^26, 28, 30) 

Reason for nonrehabilitated closttre 

Total cost of all case services 

Total cost of all case services^ 
provided in rehabilitation 
facilities 

Total cost of case services charged 
to Social Security Trust Funds 

Total cost of case services charged 
to Supplemental Security ^Income 
Funds' 

Receipt or nonreceipt and cost 
status of the following 'services : 

Diagnostic and evaluation; 

Restoration (physical or mental) ; 

College or university; 

Other academic elementary or high 
sch9al ; 

Business school or^ollege; 
Vocational school; 
On-the-job training; 
Personal and vocational adjustment ; 
Miscellaneous training; 
Maintenance ; 
Other services; 

Services to other family members 



^e R-300 Verification Instrument appears in Section I.C. of the Modified 
Case Review Schedule. "... 
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STANDARD 10: ELIGIBILITY ' 

Eligibility decisions shall be based on Accurate and 
sufficient diagnostic information, an^ VR shall con- 
tinually review and evaluate eligibility decisions t^^ 
ensure that decisions are bein^ mad^ in accordance 
with laws and re gulations^ * ^ , 

The determination of an applicant's qualif i^tions for eligibility 

is a critical point ^in the VR process for both tlS^lient and the agency. 

This standard' seeks to protect client ^interest by requiring state agencies 

to install procedures for , monitoring eligibility decisions m a sample 

of cases and ensuring that the decisions are appropriate,, in compliance ^ 

with legal requirements, and supported by the proper diagnostic information. 

This standard pertains to two broad RSA goals* First, inasmuch as the 

eligibility determination process rests on a legal footing, the standard 

* 

pertains to the goal bf compliance with the legislation. Second, it per- 
tains to the goal of cost-effectiveness, sipce it is a misuse of money to 
serve ineligible persons, particularly if other, eligible clients are turned 
away due to an incorrect determination of ineligibility. Thus, in estab- 
lishing a procedural standard for the review tff eligibility determination, 
we are concerned with the appropriateness of the decision and its accor.- 
dance with laws and regulations. expect information from this review 
to addresi two facets of this concern: (1) that clients who a^'e not 
eligible for VR services not be accepted for services, and (2) that clients 
who are eligible are indeed accepted. 

While monitoring and review ,of eligibility decisions by supervising 
counselors or managers will provide a check on that determination,' states 
have varying supervisory structures and roles and should be allowed to 
retain flexibility in 'their monitoring practices. Thtis, although crossy 
checks on impending eligibility decisions are important to conduct, they 
are not a requirement for this standard. 

The Case Review Schedule serves as the' data source for this standard. 
Table 11 shows the CRS items tised to address Standard fO; the table is 
organized* by the various relevant sections of th| CRS. 
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.T?4ble II 

Case Review Schedule (CRS) Items Used 
. for Standard 10 (Eligibility) 



t 



SECTION II; EmUATION OF REHABILITATION POTENTIAL . 

A; Preliminary biagno&tic Study - Status^ 02 

Do«6 the preliminary diagnostic study*.. • 



4. include an appraisal of the' current general health status 
of the client? 

w 

5. include a psychiatric or psychological examination in all 
. cases of mental pr emotional disorder? 

6. include such examinations and diagnostic studies as necessary 



to: . • ■ / t » 

a. determine eligibility? 

b. • determine the need for extended evaluation? 

7. place primary emphasis upon the determination of the client's 
potential for achieving a vocational goal? 

8. support the determination that the client has a medically- 
recognized physical or mental disability? 

9. support the determination that the- medically-recognized 
disabilitj^ consDitutes a substantial handicap to employ- 
ment for th^ client? - 

10. ' support the determination that VR services may reasonably 

be expected to benefit the client in terras of employability? 

11. stqjport the determination that an extended evaluation is 
necessary -to determiras that VR services may reasonably 

be expected to benefit the client in terras of^mployability? 
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>Table II (continued) 



SECTION II: EVALi/tION OF REHABIL'ITATIQN POTF.SiTTAI. 
Ex t^de d Evaluation -' Statxis 06 



Does the case record... ^ 

14. ^contain a certification for extended evaluation to 
determine rehabilitation potential? 



Does the IWRP for extended evaluation (state form) . . , 
' • • # 

19. present the general basis for a determination that an 
. i extended evaluation of rehabilitation potential is nec- 
essaiy to make a deteonnination of eligibility? 

33, show that^a thorough assessment of the client 's. progress 
was ma^e^Trt: least once in ^very 90-day period during the 
provision of/ services under the extended evaluation?, . 



DoeJ-the case record... . , ^ 

. ^. 40. contain a cerjEification .of eligibility for the continuance 
^of VR services? ^ i ♦ 

42a. show tkat the decision to terminate services was made in 
full consultation with the client, or as appropriate,! with 
the parent, guardian, ot other representative? 

42d, show that the provision was made for a jjeriodic review, at 
least annually, of tl^e ineligibility decision? 



( 
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Table 11 (continued) ^ 

SECTJON III: ELIGIBILITY ^ STATUS 10 

Does the certification of eligibility... 

Ic. indijsate that the client has met the basic eligibility 
• requirements? 



Howjwell does the counselor documentation in the case record... 

Z.^ establish the presence of a physical or mental disability 
^ with necessary medical, psychiatric, psychological, and 
• other information? 

7, . show that the substantial handicap to employment exists, 
^ even though the client is employed, because the client 

^ is unable to obtain a gainfyl occupation consistent with 

the client's capacities and abilities? 

8. sl>ow the likelihood of VR seirvxces enabling^the client to 

adhieve vocational goals consistent with the client's 
, capacities and abilities? 
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Table 11 (continued) 
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SECTION VII: TERMINATION OF CASES - STATUS OS ' , 
^lumbers in' parentheses indicate Cass Review item numbei^) 



(2) 
(S) 



(6a) 
(6c) 

(7) 
(8) 
(9) 



ao«) 

(lOd) 
(11) 
(12) 

(13«) \ 

(13c)-/ 
(U) 



(17a) 
(17c) 

(18) 

(20) 
(21) 

(») 
(24) 

(2S) 



CASE aoSED STATUS 08 FROM 00/02 - lOTERVENING REASONS 



■ { ' r 

Iffiure action? \ f 



Does the case record,,, 

document specific reasons for the c 

show that the client, or as appropriate, the parent, giiardian^ or other representative, was advised 
of the reasons for closure and the closure action taken? ' 

CASE CLOSED STATUS 08 FROM 00/02 - INELIGIBILITY 

Does the certification'^f ineligibility,, 

indicate the date of certification? * ' 

include the reasons for the detenaination .of ineligibility? 
Does the case record,',, ' ' *• 

show yiat the client does not have a raodically recognized physical or mental disability?* 

show that the client does not, have a sxibstantial handicap to employment? ^ ^ / 

show that b^ond any reasonable doubt the client is 'not expected to benefit ih terms of employability 

from VR services? 
* 

contain data supporting tha inel|»ibility determination, including: 

a suimry of aadical and STther case data obtained during the preliminary diagnostic study? 

documentation of a review of the ineligibility determination not later than 12 months following 
such deterajlirion ST^ 

show that the ineligibility determination was made only after full consultation with the client, or as^ 
appropriate, with the parent, guardian, or other representative? ^ 

document that the- client was notified in writing of the closure action takenZ. 

document that the client was informed in writing of client rights and remedies 4 including: 

the right to adminisrative review and #kir hearing? 

the right to participate in the annual review of the ineligibility determination, 

document ^>ny action and decision involving the client's request for an administrative review of - 
agency action or fair hearing? 



\ 



I 



CASE CLOSED STATUS 08 FROM 06 - INEtlGIBILITY 

Does the certification of ineligibility,,, 
indicate the date of certification? 

include the reasons for the determination of ineligibility? 
Does the case record*,* 

show that beyond any reasonable doubt the client cannot be expected 'to benefit in terms of employability 
from VR. services? ^ k / / 



contain the rationale for ihe ineligibility determination as aft amendment to the IWRP? 

show that the ineligibility determination was made only after full consultation with the client, or as 
appropriate with the parent, guard^, or other representative? ' • 

document that the client was inflJrmed in writing of the closure action taken? 

document any action and decision involving the client's request for an administrative review of 
agency action or fair hearing? 

document that the ineligibility determination was reviewed not later than 12 months following such 
determination? 
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Table 11 (continued) ' j 



SECTION VII: TERMINATION OF CASES - STATUSES 30 and 28 
7^ ' ' 

■it 

Does the certification of ineligibility... 

f 

28a indicate trfb date <vf certification? 

28c. include the reasons for the determination of ineligibility? 

* 

Does the case record... 

34. contain the rationale for the ineligibility determination 
as an amendment to the program? 

y 

35. show tha,t the ineligibility determination was made only 
after full consultation with the client, or as appropri ^ite , 
with the parent, guardian, or other representative? 

36. document that the client was notified in writing of the 

closure action taken? 

> * 

Does the case record .show, that the client was informed in writing of.. 

37a. the right to administrative review ^and fair' hearing? 

37b, the right to participate in the annual review of 
the ineligibility determination? - 

Does the case record. •« 

38, docximent any action and decision involving the client's 
request for an administrative review of agency action 
or fair hearing? 



39. document that the determination that the client was no 
longer eligible was reviewed not later than 12 months 
following such determination? 
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STANDARD 11; TIMELINESS 

VR shall ensure that eligibility decisions and client ^ 
movement through the VR process occur in a timely 
manner appropriate to the needs and capabilities of 
the clients . 

This standard seeks to avoid delays in the VI^ prpeess that are likely 
to imppde or hinder successful rehabilitation of the client. Rather than 
set a performance standard using time -in -status to define ''undue delay," 
this Procedural Standard requires that each state have a monitoring 6r 
flagging, mechanism. for cases remaining in statuses over a given length of 
time, and a procedure to evaluate the appropriateness of any* case delay* 
Many of the state VR agencies already have variations of such a system in 
place* 

This standard pertains to the RSA goal of providing quality case 
services, for two reasons. First, one aspect of ♦the quality of a client's 
service experience is the speed with which his or her case is handled: 
did the client feel that the counselor "cared" abou^ him (as evidenced 
by the fact that the counselor "kept on top of things", and "kept things 
moving along"), or did the couhselor seem to put him on a lower priority? 
The client's perception of his treatment by VR can have an impaqt on his 
attitude toward VR and about the usefulness of participation in VR. 
Second^ research on successful Rehabilitation outcomes has suggested 
a relationship between timeliness and success (perhaps as a consequence 
of the perceptions disctissed above) • ^ 

The issue of timely case movement or "undue delays" (as it is phrased 
in the current standards) has been one of long discussion and controversy. 
While there is literature to support the correspondence between certain 
times in process (particularly time to eligibility decisiqn) and outcome, 
there have also been questions about interrater reliability in the area of* 
judging timeliness of case movement through case review. Nevertheless, 
an overall review of timely case movement on a client -by-client basis 
is best handled through case review, if items can be identified which 
have good interrater reliability: ' ^ 

Much effort has gone into attempts to define, and establish standards 
for, timeliness of case service progress* As noted, research on success- 
ful rehabilitation outcomes has supported the concern for timeliness yi 
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establishing a relations^j^ between the time required for an eligbility * 
decision and ultimate client outcome. Previous attempts to monitor the 
timeliness of service provision by way of a standard on **undue delay" have 
been hampered, however,, by several problems. The first is the definitional 
and reliability problem. *TJndue delay" and its converse, "expeditious" or 
"quick and efficient" case management, mean different things' to different 
people. Thff' current standards use the approach of arbitrary time periods 
to define "timely" case moven^'ent: ^eight months has been defined as the 
limit fo» timely eligibility decisions; 22 months fot timely'corapletion of 
the VR process- This appj^oach has been widely and justifiably criticized 
for its lack of sensitivity to the legitimate differences in individual ^ 
cases: a complex case, perhaps involving long-term educational services, 
m^ght well requi^ more than 22 months without any delay. Where a case 
has been subject to a delay, the -situation is further complicated by the 
differing implications of different causes for delay: lack of client res- 
ponsiveness, inattentiofl inefficiency on the paryof the counselor or 
the VR agency, and problems outside of VR (failure of a vendor to deliver, 
unavoidable waiting lists in training programs). Each imply very differ* 
ent responsibility for time lapses and cannot equally be ascribed to VR 
agency "fail ire." - ^ 

- Thus, use of "objective" measures of timeliness has suffered from arbi- 
trariness and frequent inappropriateness of. established time cut-offs for 
many clients. Other approaches to objective meastirement, such as recording 
planned initiation and completion dates for each service, and monitoring 
compliance with the schedule,^ suffer from cumbersomeness in^ecution* On 
, the other hand, subjective judgments of timeliness have been wilnerable to 
criticisms of unreliability in application. However, this unreliability 
\^ may well have arisen due to the incorporation of 'xc/no distinct concepts 

into the previously tised "undue d|flay" judgments. This term, "imdue delay," 
includes concepts of both time lapse and judgment of blame, culpability 
or unjustifiable time lapse. (The. word "delay y itself sometimes connot^ 
willfulness or neglJLgence, an* the modifier "undue" definitely implies ' ^ 
such pr9\)lems.) Case reviewers might well differ in judgments as to the 
cause t}f a delay, and thus whether VR should be held accountable; and" for 
this reason, reviewers may dif^r in their classification of a case, one 

/ 
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citing an undue delay, another seeing an unfortunate time lapse, but being 
unwilling to label it an undue delay if client motivation or outside 
vendors played a role. ^ 

In response to the problem of a dual focus in assessing timeliness, 
a new timeliness assessment^ instrument has been developed which relies 
^on reviewer judgment, but which divides case assessments of timeliness 
in^to two segments:' first, a notation of whether delay has occurred in 
terms of time lapse between necessary activities in a case; and second, 
an assessment of the reasons for the la^§fe. The relevant questions are 
appended to the Case Review^ Schedule and concern critical phases of* case 
progress — eligibility determination, development of service plan, and 
service delivery and termination. In "addition, the Timeliness Assessment 
instrument allows for notation of whether a case was handled with 'hjmdue 
speed:'/ that is, if the case moved too fast, in the reviewer's judgment, 
given the circumstances of the case. While undue speed may be a less 
pressing concern than undue delay, the issue did come up during the 
standards pretest, ^d the Timeliness Assessment instrument has been 
TOvised to address the issue. 

The Timeliness Assessment Instnament can be used by states in conjunc- 
tion with the case-flaggin/7 mechanism for open cases, required by Standard 
11. A mechanism must be set up by each state to flag eich^ase which has 
remained in a given stattis longer than a specified period of time. Review, 
of the client's situation should then take place (in a format decided by 
the state) to determine if case movement is ajjpropriate, but no reporting 
to RSA would be required. 

' As part of its project to revise the VR Pro-am Standards, Berkeley 

Planning Associates (BPA) developed a model for improvement of case- 

r > 

f lagging- pi^act ice and tise of time in status standards at the state level. 
A state should not flag* too many cases, because such flagging would be 
inefficient. However, flagging too few cases will possibly leave too 
many untimely cases in the system without examination. The model, there- * 
fore, is based on examining the number of cases being, flagg^^d wjLth tl>e 
states' existing flagging standards, in relatiaflship to' an analysis of the 



Er|c ' " - 1^4 



Ill 



9 



service process and the overall caseload, and refining state flagging 
standards.^ 

Figiire 4 shows the steps to follow in the analysis of undue delay 
in the caseload. A case is selected for review, following the sampling 
design iised by the state agency for timeliness review (100% of all cases, 
or state random sampling procedure) . State timeliness standards (allowed 
times in process) will be used in this model The model calls for iq)- 
wards or downwards adjusting of these times in process standards (in- 
creases or decreases ii^ the maximum time allowed in each status) based 
on two additional standards for the caseloa4 itself: 

1. Not moTfi than 20% of the flagged cases should be timely. 
If more than 20% of the flagged cases are judged as timely 
when they ^e reviewed, the system is flagging cases un- 
necessarily, and the flagging standards should bp less 
stringent (times allowed in the statuses could be in- 
creased) . ' 

2. Assuming the conditions in (1) above hold, at least 5% 
but not more than 10% of all cases should be flagged. 
If such excessive flagging occurs, and the Aagging 
represents cases 'judged untimely, then there is a prob- 
lem with the service delivery system JLtself , and an 
analysis af the processJis called for. If less than 

S% of cases are flagged, the flagging system should 
be more stringent (times allowed in statuses should be 
decreased) • 

The model in figure 4 uses both quantitative information on times 

in status and siibjective information from the Timeliness Assessment 

2 

Instrximent to decide about cases. In the first stage, a case* is selected 
for attention. If time in process is all right for the case, it is re- 
turned to the file. If time in process exceeds agency standards, the case 



The full analysis leading to the proposed model can be found in 
BPA's report. Review of State VR Agency Procedures for Case Flagging 
and Quality Assurance (September 1981), available from RSA. 

2 ' t 

Thft model is, however, concerned only with times-in-status which 

are too long ; it does not address "rushed** cases. Cases handled with 

"undue speed" arc a separate issue requiring sijecial state attention. 
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Fieure_4: Model Case Flagging Systea 
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. is flagged and reviewed as to the timeliness -af^^ the prdcess. As we have 
pointed out, while there is a relationship between timeliness and time in 
process, it is not a one-to-one relationship, so it is possible that 
flagged cases will be judged timely. If so, they also can be returned to 
the file. For both these groups returned to the file (labeled A and B 
on Figure 4), the number of such cases should be recorded. Likewise, 
the number of untimely cases flagged should be count'ed. (In the figure, 
this is C.) Cases should be flagged and reviewed until the planned sample 
size (A + B + C) is achieved. *J ^ 

Once the sample is complete, the system aslfe three, questions of the 
cases. First, do the timely cases (B) exceed 20% of all flagged (B + C) 
cases? If yes, the ^system may be flagging too many cases, and times 
allowed for each status could be increased. If, however, B/(B + Q is 
less than 20%, the system asks whether less than 10* ,of the total case- 
load was flagged. If so, then the time in process standards appears in 
equilibrium for the state (not too many cases are being flagged; of the 
cases that are flagged, most of them are indeed untimely cases). If, on 
the other hand, more than XOh of the cases are flagged, there is a problem 
in the service process itself, since these cases have been judged as un- 
timely and there are too many untimely cases for efficient monitoring and 
efficient operations. This calls for an examination of the service 
process itself, perhaps using the decision support system to analyze 
the state caseload process and pinpoint timeliness issues in relationship 
to client outcomes and costs. In addition, this problem may call for 
upward adjustment of the times allowed in statuses, to flag fewer cases. 
However, checking 'for the appropriate times must be done in another itera- 
tion so that a check can be made as to whether both the 20* and 10% 
standards are met for a given new standards level. 

Finally, the state should routinely flag between S% and 10% of its 
cases, to assure that flagging standards are set low enough, if less tha 
S% of cases are flagged, the standards should be made more stringent 
(allowed times in status decreased) b'e^ore the next round of review • 

U^ing this approach, states can adjust their times* in status standards 
upwards or downwar^ds to be more meaningful and to result in an efficient 
process that spot^ problematic cases without excessive monitoring. 
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The above discussion shows how Standard 11 can be of use. within 
state agencies. In addition, RSA will conduct the Timeliness Assessment 
in each state agency independent of the agency's case flagging 
mechanism — as part of its Procedural Standards -data collection. The 
results will inform RSA of the e:^tent of untimely case service in a state, 
and the -results will be forwarded to the agency. 

The, Timeliness Assessment Instrument appears as Section VIII of the 
Case Rwiew Schedule. Tsfele^ 12..^hows the information items obtained for 

» 9 

each reviewed case by the Timeliness Assessment Instrument. 

■< 




Table 12 

Information Items Obtained by the Timeliness 
Assessment Instrument for Reviewed Cases 



1. Was the case handled in a timely maimer (i.e., without undue 
speed or undue delay)? 

2. If undue speed: 
a. Reasons for judging the case as moving too fast. 

3. If undue delay; 

a. Were the reasons for delay documented in the clients' 
case record? 

b. Reasons .for delay. 

^The Tilneliness Assessment Instrument appears in Section Vlil'of the' Modified 
Case Review Schedule, ' ' J' . 
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STANDARD 12: imP 

VR shall provide an Individualized Written Rehabilitation 
Program for each applicable client, and VR and the client 
shall be accoimtable to each other for complying with this 
agreement * 

Several aspects of the Individualized Written Rehabilitation Program 
are addressed in this Procedural Standard: (a) compliance with the require 
ment that an IWRP be fully developed for clients accepted for services or 
extended evaluation; (b) assurance of t^e protection of client rights and 
client, awareness of the remedies available for mitigating dissatisfaction; 
(c) joint client/counselor development of the job goal and the service 
plan; (d) mutual client/counselor responsibility for follow- through on the 
agreement and annual review of its progress and appropriateness; and (e) 
the appropriate handling of plan revisions • 

This standard bears a relation to the RSA goals of ensuring compliance 
and quality case services. Obvioxasly, given the regulations mandating pro- 
vision of an IWRP to all accepted clients, this standard's relation to the 
compliance goal is clear. While the regulations concerning the IWRP stipu- 
late compliance with the provisions of the law, elevating the issue to the 
level o£ a procedural standard will ensure compliance with the legislative, 
intent of the IWRP. 

Inclusion of this standard could be justified simply on the basis of 
the strong regulation regarding compliance with the IWRP provisions of 
the 1973 Rehabilitation Act* However; perhaps an even more important 
reason to include this, standard i^the faet that research has shown a 
positivis association between compliance with the IWRP requirements* and 
successful outcomes of the VR process. Since research has supported the 
premises underpinning the IWRP by showing that the process and the pos- 
session of the IWRP affect client outcomes positively, adherence to the 
IWRP requirements becomes a powerful norm for quality case management in 
VR, as well as a protection, of client interests and righlts, 

The basic Case^eview Schedule serves as the data source for this 
standard. , Table 13 shows the CRS iteips used to address Standard 12, 
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Table 13' 

Case Review Schedule (CRS) Items Used 
^ for Standard 12 (IWRE) ^ 



SECTION II; EVALUATION OF REHABILI<t:mON POTENTIAL 
B: Extended Evaluation - Stattis 06 

18. Is there an IWRP for extended* evaluation in the case record? 



Does the IWRP for extended evaluation (state form)... 

19. present the general basis for a determination that an 
extended evaluation of rehabilitation potential is 
necessary to make a determination o£ eligibility? 

20. Set forth the terms and conditions for the provision 
servicq, including: 

a. client responsibilities in carrying out the 
progrim, such as attendance, cooperation, etc.? 

b. the e:ctent of client participation in the cost 
of services? ^ " 

21. document that the client was informed of client rights and 
remedies, including: \ 

a. the right to be fully consulted regarding 

any changes or amendments in the rehabilitation / 
program? • 

1). the right to administrative review in case of 
dissatisfaction with services? 

d. the right to .participate in the annual review of 
the program? 

-e. the right to participate in the annual review of 
^ the ineligibility decision? 



22. reflect that the IWRP for extended evaluation was maintained 
as a separate part of the case record? . 

23. show that the client received a copy of the IWRP and sub- 
stantial amendments? 

26« indicate that the program was developed and amended with 
the client's participatioq, or as appropr^iate , with the 
parent, guardian,' or other representative? 

28. state the intermediate rehabilitation objectives? 
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Table 13 (continued) 



SECTIDN II.B (continued) | 

Does the IWRP for extended evaluation (state form),.. 

29. state' the VR services to be provided .which are" Tie cess ary 
for the determination of rehabilitation potential? 

30. contain the projected date for the initiation of each 
service? 



31. contain the anticipated duration for each service planned? 

32. provide the projected time wjthin which rehabilitation*'^' 
objectives may be. achieved? 

33. show that a thorough assessment of the client's progress 
was made at least once in every 90-day period during the 
provision of services under the extended evaluation? 

34. state the objective criteria upon which an evaluation of 
the client's progress is based? 

35. state the procedure by which the client is evaluated? 

36i| contain a schedule for the periodic review and progress ^ 
evaluation? 

37. contain a record of the results of schedi4ed reviews and 
progress evaluations? 

38. show that a formal, annual review has been conducted if the 
t IWRP has achieved at least first anniversary statxis? 

39. document the client's views, or, as appropriate, the views 
of the parent, guardian, or other representative concerning 
the objectives and^ services being provided? 

Poes the case recbrd... 

42a. show that the decision to terminate services was made in 
full consultation with the client, or as appropriate, with 
the parent, guardian, or other representative? - 

42b. show that the rationale for the decision to terminate 
services was recorded as a certified amendment to the 
IWRP for' extended evaluation? 

42c^. show that a certification of ineligibility was thep executed? 

42d.^ shpw that the provision was made for a periodic review, at 
* least annually, of the ineligibility decision? 
Z T ' 1 
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Table 13 (continued) 



-h 



SECTION- iK B (continued) 
Questions 43 through 51 have two parts: 

Item B: Does the case record dociiment that the service was planned 
for the client? 

Item C: Does the case record document that the service was given to 
. the client? 

Each item is asked^in reference to the followiiig services (keyed to 
CRS question numbers) . 

43. Diagnostic and Related Services 

44. CounseJHJng and Guidance 

45. Physical Restoration 

46. Mental Restoration 

47. Vocational and Other Training 

48. Maintenance ^ 

49 . Transporation 

50. Services to the Family \ 

51. Specialized Services for Blind, Deaf, Severe Disabilities 

52. Telecommtmications 

53. Occupational Licenses, Jools, Equipment 

54. Other Goods and Services 



v.? 
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SECTION V:. INDIVIDUALIZED WRITTEN REHABILITATION PROGRAM - 
STATUS 12 AND ABOVE ^ 

1. is there an IWRP in the case record? 
Does the IWRP (state form)... 

u 

2. present the general basis for a determination of eligibility? 

^. set forth » the terras and conditions for the provision of 
services, including: 

a. client responsibilities in carrying out the 
program, such as cooperation, attendance, etc.? 

b. the extent of client participation in the cost 
of services? 

4. document that the client was informed of client rights and 
remedies, including: 

a. the right to be fully consulted regarding any 
changes or amendments in thp rehabilitation 
prograiji? 

b. the right to administrative review in case of 
dissatisfaction with services? 

d» the riglit to participate in the annual review of 
the program? 

e» the right to participate in the annual review of 
the ineligibility decision? 

5. reflect that the IWRP was maintained as a separate part of 
the case record? 

6. show that the client received a copy of the IWRP and ' 
substantial amendments? 

» 

9. indicate that the program was developed and amended with 
js^ the client's participation or, as appropriate with the 
parent, guardian, or other representative? 

11. glace primary emphasis on the determination and achieve- 
ment of a vocational goal? 

12. state the ^^^^g-range employment, goal? 

13. state the intermediate rehabilitation objectives? ^ 
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SECTION V (continued) 



Does the IWRP (state form) 
14. 



state the specific VR services to be provided to 
achieve the intermediate objectives and the employment 
goal? 



15. contain the projected date for the initiation of each 
service? 

16. contain the anticipated duration for each service 
4 planned? 

17- provide- the projected time within' which rehabilitation 
objectives and goals may be achieved? 

18. state the objective criteria upon which an evaluation of 
the client's progress toward an employability goal is 
based? 

19. state the procedure by which the client is evaluated? 

20 . contain a schedule -for the periodic reviews and pro^ss 
evaluations? 

21. contain a record of the results of the scheduled reviews 
3 id evaluations? 



22. show that -a formal, annual review has been conducted, if , • 
the IWRP has achieved at least first anniversary statxis? . 

23. document the client's views, or as appropriate, the views 
of the'^arent, guardian, or other representative concerning 
the goals, objectives, and VR services being provided? 
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Table 13 (conrinued) 



SECTION V 


(continued) 


Does 


the 


case record. . . 




24a. 


show that the de.cision to terminate services was made in full 
consultation with the client or as appropriate, with the 
parent, guardian, or other representative? 




24b; 


' show that the rationale for th^ decision to terminate seandces 
was recorded as a certified amendment to the IWRP? 




24c. 


show that a certification of ineligibility was then 
executed? 




-24d. show that the provision was made for a periodic review, 
s^at least annually, o£ the ineligibility decision?^ 




2S. 


contain a closure statement as an amendment to the program 
for a case closed rehabilitated? 


Does 


the 


closure statement... ^ ^ . 




2Sa. 


*a description of the basis upon which tJTe client was } 
determined to be rehabilitated? 

* 




2^. 


Is there an amended IWRP for Post Employment Services? 
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SECTION VI; DELIVERY OF SERVICES^ STATUSES 14, 16, 18, 20, 22 and 32 
Questions 1-14 have two parts r 

Item Does the case reco^^d document that the service was planned 
for the client? 

Item C; Does the case record. document that the service was given- 
' to the client? . ^ 



Each item is asked in reference to the following services (keyed to 
CRS question numbers) . • * ' ' ' 

Services: ' ^ 



1. '"Evaluation and Diagnostic Services 

2. Counseling and Guidance 

3. Physical Restoration 

4. Mental Restoration' ^ 

5. Vocational and "Other Training 

6. Maintenance ^ 

7 . Transpor ta ti on , / 

8. Service:> to the Family 

• * , . -« ' 

9. Specialized Services for Blind, Deaf, Severe Disabilities 

10. Telecommunications 

11. Occupational Licenses, Tools; Equipment 

12. Other Goods and Services 

13. Placement 

14. Tost-Ehployment 
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SECTION. VII: TERMINATION OF CASES - STATUSES 30 and 28 



Does the case record**. , 

34* contain the rationale for the ineligibility determination 
as an, amendment to the program? 

35* show that the ineligibility determination was made only 

after full consultation with the client, or as appropriate, 
with the parent, guardian, or other representative?^ 




^^is is the. same wording as used in item 20 (not shown) pei^tai?«qM: to 
clients closed OS^rom 06; except that the word "IlfRP" is substiwtfed 
for "program." 

b * " 

This is the same wording asf used in Item 22 (not shown) pertaining to 
clients closed 08 from 06. 

1 - . 
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STANDARD 13: GOAL PLANNING 

Counselors shall make an effort to set realistic 
goals for clients ♦ Comprehensive consideration nnist 
be given to all factors in developing appropriate 
/ vocational goals such tjiat there is ^ raaximiim of 

correspondence between goals and outcomes ; competi- 
^ tive goals should have competitive outcomes and non- 
competitive goals should have noncompetitive outcomes . 

Competitive employment may not be. the appropriate placement for all 
clients. Nevertheless, VR regxxlations require that all placements be into 
"gainful activity" and that placements be consistent with the clients' 
"capacities and abilities," whether in competitive, sheltered, or noncom- 
petitive employment. 

There is much speculation in the field over the abuse of "homemaker" 
and "unpaid family worker" categories,- specifically regarding the use of 
thise categories to ensure success rather than because the placement is 
appropriate. While maximizing the proportion of successful closures 
in data element 3(i)) is important to the purpose of VR, it does not ensure 
that noncompetitive placements are suitable for the client. This standard 
addresses the concern that noncon5)etitive closure categories not be used 
to salvage "successes" for clients who were unsuccessful in their planned 
competitive goals. 

However, this standard is not intended to "freeze" counselors and 
£heir clients inno goals as set out in the .original IWRP. Such an effect * 
would be a misapitifcation of the IWRP process. The IWRP is intended to 
be a statement of a realistically attainable goal which, if necessary, 
can be modified for a variety of valid reasons as the client progresses 
through the VR process. That is, the IWRP serves as a, guideline rather 
than as a hard and fast rule. 

As such, state agencies should not use the results found for the 
standard in such a way as to overemphasize the importance of. matching the 
outcome to the goal. This would serve as a disincentive to setting 
ambitious (i.e., competitive employment) goals in the original IWRP, and 
would reduce the flexibility of the counselor in refining the goal in 
Response to client progress during the rehabilitation process. Instead, if 
"problems" emerge on the standards the results should be used in conjimction 
with data on client characteristics and services provided to investigate how 
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counselors can be more effective in the task of "fitting" clients' potentials 
to feasible ultimate outcomes. In this way, the standard is used appro- 
priately to facilitate effective goal -planning jrather than simply to foctis 
on' whether goals matched outcomes, ♦ 

Standard 13 uses .four variations^on a. common theme as data elementXj^ 

(i) » of 26 closirres with competitive goal AND competitive outcome 

t of 26 closures 



(ii) # of 26 closures with competitive goal BUT noncompetitive outcome 
t of 26 closures 



(iii) » of 26^closures with noncompetitive goal AND noncOBpetive outcome 
# of 26 closures ] 



(iv) » of 26 closures with noncompetive goal BUT competitive outcome 
# of 26 closures 

The RSA-300 provides the data necessary to adjdress this standard. 
The location of the data is shoym in Exhibit.. 1. Because this standard uses ^ 
R-300 data, it can be reported annually. * 
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COMPUTING THE PROCEDURAL STANDARDS DATA ELEMENTS 

As stated earlier in this chapter, the data elements for the Proced- 
ural Standards consist, for the most pwrt, of individual information items 
pertaining to specific aspects of the standard in question • In the Pro- 
* cedural Standards reports,^ these information items will be presented in 
terms of a series of "percentage achieved" scores j for example, the per- 
cent of reviewed case records which "document that the client was informed 
of client rights and remedies, including the right to be fully; consulted 
regarding any changes or amendments in the rehabilitatifti programV (CRS, 
Item V, 4*a, used for Standard 12), Likewise, all other items from the 
CRS will be computed and reported as a "percentage achieved" score 
With this, program managers will be able to see the extent^'^ which an 
agency is in compliance {or has valid R-300 data, or serves its clients 
in a timely manner) in terms of a number of separate indicators • This 
will allow program managers to pinpoint specific problems occtirring in 
the case-handling and data-recording processes ^of the agency. 

The one exception to the "percentage achieved" method occurs on 
Standard 13. As noted in the discussion of that standard, its data ele- 
mei^s consist of four similar ratios, each of which compare clients* IWRP 
goals to their ultimate outcojpes. The RSA-300 provides the require^ data. 

Given the straightforward interpretation of the Procedural Standards 
data elements, the instructions for computing the data elements ^an be 
stated simply; 

1) collect the necessary data; and * 

2) compute the percentages, tising valid cases only.* 

The only remaining taj?k is to specify the information items used for 
the Procedural Standards. Table 14 provides the specifications. The table 
lists the Procedural Standards (and, for Standard 13, the four data ele- 
ments) , the data source and item specifications, and the page references 
fpr the data items and instructions for completing the data items. , 



As with the Performance Standards data elements, the "percentage 
achieved" scores must be computed using valid cases oniy > In the'example 
given above, for instance, we would divide the number of cases for which 
the case record 'documented that the client had been "informed of rights 
and remedies regarding IWRP changes," by the number of clients reaching 
Status 12. All other cases are "invalid" (for this particular data element) 
and are not to be used in computing the percentage score. 
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Ta6le M 

SuMmry of Sundards, DaU Sources, tnd D«f Specifications 
for the VR Prograa Procedural Standards 



Standard 



Data Source 



Data Specifications 



Page Reference 



Data Items 



Instructions 
for Data Items 



R-300 Validity 

Inforaation collected on clients by the R-300 
and all data reportlni systems usod by RSA % 
shSll be valid, reliable, accurate, and com* 
plete. 



Modified 
Case Review 
Schedule 



Section I.C (R-300 Verification 
Instrument) 



141 - 144 
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10. EligibiHty 

Biifibility clecision^ shall be based on 
accurate and sufficient dia|nostic informa- 
tion, and^VR shall continually review and 
evaluate eligibility decisiont to ensure 
that decisions arc being made In' accordance 
with laws and regulations* ^ 



Modified 
Case Review 
Schedule 



42a, 42d 



Section II. A.: 4-11 

Section ^I.i.: 14, 19, 33, 40, 

Section III: Ic, 3, 7, 8 

Section VII: 2, 5, 6a, 6c, 7, I, 9, 10a, 

lOd, 11, 12, 13a, 13c, 14, ji 
17a, 17c, 18, 20, 21, 23, ,24, 
25, 28a, 28c, 34, 35, 36, 
37«, 37b, 38, 39 



145 

146 - 149 

150 - 151 

f57 - 164 



176 - 177 
178 - 186 
187 - 190 
202 * 209 



lly Timeliness 

VR shall ensure that eligibility decisions 
*ai)d client movement through the'VR pro- 
,cess occur in a timely manner appropriate 
to the needs and capabilities of the 
clients. 



»k>dified 
Case Review 
Schedule 



Section VIII.A and Vlll.i (Timeliness 
Assessment Instrument}^ 



165 - 166 



210 - 211 



12. IWRP 



VR shall provide an Individualized Written 
Rehabili(|tion Program for ({ach applicable 
client and VR and the client shall be ac- 
countable to each other for complying with 
this agreement. 



Modified 
Case Review 
Schedule 



Section II. i: U, 19, 20a, 20b^ 21a, ^21b, 
21d, 21e, 22, 23, 26, 28-3^, 
42a, 42b, 42c, 42d, 43-54B, 
'43-54C 

Section V: 1, 2, 3a/ 3b, 4a, 4b, 4d, 4e, 
5, 6, d, 11-25, 24a, 24b^ 24c, 
24d, 25a, 26 
Section VI: lrl4B, 1-14C 
Section VII: 20, 22, 34, 35 



146 - 149 



153 - 155 



156 

157 - ^64 



171 - 186 



1^2 - 196 



197 - 201 
202 - 209 
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Tabic 14 (continued) 









Page Reference 


Standard 


Datk ^urce 


Data Specifications 


Data Itemis 


Instructions 
for Data Items 


4 

13. Goal Planning 


RSA-30b: 








Counselors shall aake an effort to set realis- 
tic goals for clients. Comprehensive consid- 
eration Bust be given to all factors in 
developing appropriate vocational goals such 
that there is a naxiaua of correspondence 
between goals and outcomes: competitive 
goals should have coapetitive^ outcomes and 
noncompetitive goals should have noncompeti- 
tive outcomes. 


Kork Status 
of IWRp'Coal 

Mork Status 
at Closure 

f 26 closures 


Item 3.B {Competitive employment ■ codes .1 
(wage and salary workers] and 3 
(self-ei^loyed, not B£P)] 

Item 4.1 (Co^etitive employment *> same 
as for Item 3.B] 

Item 4. P. 2 (total number) 


63 - 70 

- 


65 


^- 










Data Elenents: 










(i) * i of 26 clpsures with competitive 
goal AND competitive outcome 
' of 26 closures * 










(ii) ' of 26 closures with competitive 
goal BUT noncompetitive outcome 
1 of 26 closures 




• 






(iii) 1 of 26 closures with noncompetitive 
goal AND noncompetitive outcome 
1 of 26 closures 










(iv) 1 of 26 closures with noncompetitive 
goal BUT competitive outcome 
f of 26 closures 
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DATA SOURCES FOR THE PROCEDURAL STANDARDS; CASE REVIEW SCHEDUL E ^ 
~ I , 

ks noted in the introduction to this chapter, most of the data for the 
Procedural Standards will come from a process of case review; the only excep- 
tion is Standard 13, which will use R-300 data aS described in the sections 
on Jhe R-300 and on Standard 13. For Standards 9-12, the case review pro- 
cess will be conducted using a modification of the Case Review Schedule (CRS) 
developed by the San Diego State University RCEP IX. ^ 

As part of its project to revise the VR Program Standards, Berkeley 
Planning Associates (BPA) reviewed the CRS and selected those items needed 
to adequately address Standards 10 (Eligibility) and 12>(IWRP). In ad4ition, 
items were selected which were felt to be of use in the problem identification 
stages of the decision-support system (see pp. 14-21) for a discussion of this 
system). Fiftally, BPA developed two new instruments — the R-300 Verification 
Instrument and the Timeliness Assessment Instrument ~ to address the Proced- 
ural Standards not already covered by the CRS. BPA merged those two new 
instruments with the items from the existing CRS — selected to address Stand- 
ards 10 and 12, and the problem identirfication activity — to form a new 
Modified Case Review Schedule ' (MCRS) . The MCRS serves as the unified data 
source for Standards 9-12. . * 

« 

The MCRS is presented in Exhibit 9. FolJowihg this, Exhibit 10 provides 
the detailed instructions for completing , the separate MCRS items ♦ Below, we 
briefly describe each of the sections of the MCRS: their use in the Procedural 
Standards, and the information they elicit* * - ' 

Sections I.^A: and I.B; Identifying Information and Significa^t Case Data 

These ^Sections provide information to identify the client (e»g., his or 
her case nttraber) for use in analyzing the other MCRS"^ata and for merging - 
the data wi^t^ other documents (such ^ the client's R-300). As well. Section 
I.B.frecords certain significant dates relevant to the client *5 program exper- 
ience (e.g., date of service initiation). These are used as supplemental 
information for Standards^^-* 12 * ' 

Section I,Cr R-500 Verification Instrument 

The R-300 Verification instrument is designed to respond to Standard 9. 
It assesses the degree to which information submitted to RSA on critical 
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items of the R-300 was corroborated by casefile information. All of the data 
items on the R-300 Verification instrument are necessary to ensure the 
integrity of the data source on which many of the .Performance Standards' data 
elements are based. One of the purposes of Standard 9 is to verify the R-300 
information such that users of the R-300 data can have confidence in the 
accuracy of the d^ta reported to the states, the department administration, 
and the Congress. In the Procedural Standards, "verification of accuracy" 
refers to a manual confirmation procedure intended to insure that file inform- 
ation supports and corroborates the R-300 documents. 

■4 

S^/ction II. A: Evaluation of Rehabilitation Potential : 
Preliminary Diagnostic Study Status 02 

This section, used for Standard 10, assesses the extent to which the case 
record documents the ocqurrence of the various- activities needed to conduct 
an effective preliminary diagnofstic study. This study, completed during the 
application phase, should contain all of the information necessary to m^e a 
reasonable assessment of a client's eligibility for VR services. Among these 

i 

necessary pieces of information are all relevant medical and psychiatric exam- 
inations, and other evidence that supports the client's need and eligibility 
for rehabilitation services. V/ithout this information, agencies will not be 
able to select the disabled individuals who can most benefit from available 
— but limited VR services. - . • 

Section II. B: Evaluation of Rehabilitation Potential : 
Extended Evaluation - Status 06 

Section 11^. B is used for Standards 10 ^d 12, and for problem identifi- 
cation. In regards to Standard 10 (Eligibility)', Section II^B seeks document- 
ation that the state agency has followed proper propedpre in placing 
applicants into extended evaluation, status 06. In particular, the concerns 
are that case records include: \^ ' 

m a certifiipation for extended evaluation to determine rehabil- 
itation potential; 

' ' ' ; 

the basis for the need for extended evaluation; 

m evidence of the occurrence of thoroygh assessments of progress, 
at least every 90 days; and 
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• documentation of the eligibility decision resulting from 
extended evaluation. 

Provision of this information helps ensure that extended evaluation is used 
only when appropriate,* that the client moves through extended evaluation in 
a timely manner, and that the minimal recording needs for Status 06 are main- 
tained, r ' ^ 

In regards to Sta[ndard 12 (IWRP), this se'ctioiv seeks to document that 
the IWRP^s for clients placed into extended evaluation contain iilL of the 
information requii/ed under Status 06. In this context, the concerns of the 
Procedural Standards are that IWRP's for cases entering 06 do the following: 

• define the terms and conditions for the provision of servicdls; 

• document that the client was informed of specific, rights, in- 
cluding the right to participate in the development of the 
program; 

• specify a vocational goal and a timeframe for its achievement; 

• specify evaluation procedures and criteria; / ' 

• document the final eligibility decision and, for those clients 
closed as. ineligible: . . - * . ^ 

— document that the client parti'cipated in the decision; " 
and 

— document that provision was made for. periodic review^ 

Provision of this information helps ensinre adherance to the IWRP provisighs, * 
and helps ensure that clients move through Status 06 in a timely manner and 
are aware of their rights to continued services ^r review if declared inelig- 
ible. 



Section III: Eligibility - Status 10 ' ' 

While it is important to document in the preliminary diagnostic study 
the extent to which applicants meet the basic eligibility criteria, it is 
eVen more important to ensure 'that aJLl clients accepted for 'services meet 
all of the requirements for eligibility. The purpose of Section HI is to 
document that a certification of eligibility was completed for each accepted 
clijpnt, and that counselor documentation in the case record confirms: . 
' the existence of a disability; 

• the ejcistence of a substantial handicap ro employment; ami 
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• the likelihood mat VR services will benefit the clients. 

a 

Given the fundamental importance of these three items in eligibility decisions, 
Section Ill's relevance to Standard 10 should be readily apparent. 

Section IV; Evaluation of Rehabilitation Potential : 

Thorou^ Diagnostic Study Status 02 and 10 • , 

* This section is used solely for problem identification. It includes 

questions on the quality and scope* of the thorough diagnostic study. 

• t 

Section V: Individualized Written Rehabilitation Program - Status 12 . ^ 

Section V is used for Standard 12.(IWRP). In a sense, the purpose of ' 
the IWRP is to establish an alliance between the agency and the client for 
the provision of certain services toward the achievement of a, specific voca* 
tional goal. As such, it is important that the IIVRP contains all the inform* 
ation necessary to establish such an alliance. Section V attempts to document . 
among other things: 

• that^the' client was informed of the terms and conditions for 
the provision of services; , • 

• * that the client was informed of client rights; 

• * • 

J that the client participated in the full planning and review 
process; and , . ' . • 

• that the IWRP contains essential information such as goals, 
timej^ames, evaluation procedures, and schedules, etc. 

Inclusion of this inforB||tion in the IWRP clarifies the roles, relation* 
ships , and duties of agency, and client toward achieving the vocational go^. 
.This. is the essence of the IWRP process. 

Section VI: Delivery of Services - Statuses 14, 16, 18, 20, 22^ and 32 

This section, used for Standard 12, complements the information provided 
in Section V. IVhen these two are taken together, they describe the overall", 
VR process, consisting of the plan (i.e., the terms, conditions, and informa- 
tion set forth in the IWRP needed to provide serviceisO and the specific 
program of services undertaken to achieve the vocation^ goal embodied in the 
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IWRP. By knowing the extent to which planned services are actually delivered, 
we can determine the extent of effecti.ve "follow through" on the service plan- 
ning process, in keeping with the spirit of the IIVRP legislation. 

Section VII: Termination of Cases ^ , - , 

Section VII relates to Standards 10 and 12. -As might be expected ^ven 
its focus on eligibility, the questions used for Standard '10 focus on non- 
successful closures; 08»s (from both 02 and 06), 28»s, and 30*s. For these 
closure statuses, Standard%10 attempts to assess (through review of case record 
documentation) the following compliance issues: * 

• .Does the case record doctoment the ineligibility/terraination 
-decision, and tl\e basis for that decision? 

• Have clients been granted their legal rights to participate in 
the ineligibility/termination decision? 

• Have clients been informed of their right to an annual review 

of tile decision? and . - " 

• Have the required annual reviews occurred, and the results 
documented? 

' The need forj^s information is two-fold* First, it is reasonable to 
expect that supervisory personnel might want to review any given case involv- 
ings ineligibility or unsuccessful termination for any given counselor* 
Management personnel should have the ability to review cases sampled at random' 
(i*e*, across all counselors, as in in audit-type procedure), pr to;t|^get 
reviews to particular counselors (as might be needed for less experienced 
counselors);. Either way, it follows that for any case of ineligibility or 
unsuccessful closure, the closure action and the basis_^ for. it must be ade- 
quately documented in the case record* 

This information in Section VII is important for a' second reason, which 
stems from VR's desire to protept the rights of i€s applicants and clients* 
The. best way- to ensure such client protection is to require proof in the case 
record that the necessary steps have occurred: for example, a "Bill of 
.Rights" signed by the client; a schedule for review, signed perhaps by the 
client; and "Results of Review!* form, which could be signed by the client* 



148 



13S 



In short, VR agencies need to know the reasons for unsuccessful closures, 
and need to ensure that ineligibles and unsuccessful closures are aware of 
their rights to review. Once this is ensured!, th^n infoimed clients whose 
circumstances have changed such that they are eligible hopefully will re- 
enter the system later and be successfully rehabilitated*^ 

In addition t(^^'l| J^^^ assessing eligibility-determination processes. 
Section VII is alstfuus^dr^^^|tanda^^ 12, on the IWRP* The questions used 
here seek , to ensure":,; ^j^^ 

• that the rationale for closure decisions are recorded on the ? * 
Iltll^; and 

• that the client (or his/her appropriate' repi'esentative) was 
consulted prior to the closurMd^ision. 

PjQvision of this informai^ion^sures tlftat thfe agency has a source from 
which it can draw information about past ineligibility decisions, to make 
sure they were made in a consistent manner, apd to ensure that client righ^ts 
were protected during the closure process. 

Finally, several questions pertaining "fo 26 closures are included 
in Section VII these questions will be used for problem' identification ♦ 

Section VIII: Timeliness Assessment Instrument 

The Timeliness Assessment instrument responds directly to Standard 11 • 
It is designed toilink subjective assessmen.ts of the timeliness of case move- 
ment to objective data on the length of time spent in various statuses by 
different disability types ♦ The ^assessments are used in conjunction with , 
data on client characteristics and services provided, to investigate how 
agenci-os might avoid undue delays in the service process. 
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EXHIBIT 9 
Modified Case Review Schedule 



(MCRS) 



1 



The uses of the MCRS are as follows: , \1 

• Sections I. A and I.B: identifying and supplemental information 
^ Seetion ^.C: address Standard 9 (R-300 Validity) 

• Sections II. A - VII: address Standard 10 (Eligibility) and 12 
(IWRP), aiid provide in-rdepth information for decision-support 
system 

• Sections VJII^A and VIII, B: address Standard 11 (Timeliness) 

In Sections JI,A through VIL'the reader will find, in the left-hand margin 
next to each^item,^^ notation as to the uses of the item, as follows: 

10 a Standard 10 . ' ' 

12 = Standard 12 

D = decision-support system* 
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Exhibit 9 (cont.) 



MODIFIED . ' 
CASE REVIEW SCHEDULE 

Table ^of Contents 



SECTION" I ; 



SECTION II:. 



SECTION 
SECTION 

SECTION 

SECTION 

SECTION 



III; 
IV: 

V: 

VI: 

VII: 



SECTION VIII: 



CASE INFORMATION 

A. Case Identification 

B. Significant 'Data . . ^ . . . .■ 

C. ^ R-300 Verificata,on 

EVALUATION OF REHABILITATION "^TENTIAL 
A. Preliminary Diagnostic Study — Status 02 •. 
Br Extended Evaluation — .Status 06 ..... 

ELIGIBILITY'-- STATUS 10 . 

EVALUATION OF REHABILITATION POTENTIAL THOROUGH 
DIAGNOSTIC STUDY — STATUSES 02 AND 10 .... 

INDIVIDUALIZED WRITTEN REHABILITATION PROGRAM 

(IWRP) — ^'^^^r-^ \ 

DELIVERY OF SERVICcS — STATUSES 14, 16, 18, 2d, 

22, AND 32 ji. . . . . . 

TERMINATIOtI OF CASES X^^^^i^^ ^ . * 

A. Case Closed Status 08 »om 00/02 ^ ' ^ 
^ Intervening Reasons V . 

B. ^ Case Closed Statiis 08 .from 00/t)2 — • , , 

Ineligibiil^ty . ^ ^ 

C. Case. Closed Status 08 from 06 — . 
Ineligibility . ; \.^.. 

D. Case Closed Status 30 or Status 28 — 

Not Rehabilitated, * 

E. Case Closed' Status 26 — Rehabilitated 

TIMELINESS RESEARCH AND COMNENTS 

A. Timeliness 

B. Reviewer Conmients w ..... . 
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Exhibit 9 (contQ 

1 



INSTRUCTIONS FOR SECTIONS I - VIII 



To conplete the' questions in Section I through VIII, please follow these 
special instructions: 

♦ • 

4 

1* Read the directions at the top of each page and within each page, 
when provided. 

2. Answer every question unless otherwise instructed (see Manual: ^todified 
Case Review Schedule Instructions) . 



3. I'lark the appropriate answer space to the ri^t of the question, 

4. Do not fill in more than one space for any single row. That is, give 
<only one response to each question. 

5. Upe a soft lead pencil (No. 2 is ideal) and observe these important 
requirements: " ' . , 

Make heavy black marks that fill the circle. 

Erase completely any answer you wish to chaise. 

Hake na stray- markings of any . kind. 



This sdiedule is designed for machine scoring of your responses. 
Questions are answered by marking the appropriate answer spaces as 
illustrated in this example: 

I 

,c o 

Q r-» 

Ok ^ *ri U 

0 1-^0) 4J 

ea CO cu o 



Qaestion - Ifliich is the only marking 

instrument that will be read 
properly: Correct Answer 



® • © 
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Exhibit 9 (cont.) 



SECnaM I: 'G\SE INTOWWTION 

A: CASE IDENTIFICATI<»< 



ANSWER COLUMN 
(Write in Space Provided) 



NOTE: I^^PORTANT INSTTOXmOfiS 

For individuals who were previously 
clients, review only fron date case laost 
recently opened. 

Answer all itens using code nunbers in 
square(s) provided. Refer to code 
sheets in taanual for itens noted with 
(code) and enter appropriate code on this 
page. 



1. Reviewer ^nitials 

2. Reviewer: 

(1) State; (2) Federml; 

(3) Other (specify) 



3. Reviewer: 

(I) Administrator; (2) Supervisor; 
(3) Counselor; (4) Other (specify) 



4. Date of Review: 

5. State Agency (code): 

6. Case Kuaber: 

7. Case Status: 



□ 



□ 



YR 



SECTION I: CASE INFORMATION 
-B: SICJilFICANT DATA 



K 13. Date certified as accepted for vocational 
rehabilitation services: 



14. Date initial IWRP written and approved: 



IS. Date of initiation of VR services: 



1 1 Ml II 11 




DAY 


YR 


i i 1.1 Ml l-l 


MO 


DAY 


m 


1 1 1 1 1 .1 1 1 1 


MO 


DAY 


'^R 
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Exhibit 9 (cont.) 



SECTKW I: CASE IHFORMATIOi 

C: R-300 V'ERIFICATIOH 



(r.fO Does the client's case record conc^n a copy of the case service 
report R-300 or the equivalent state statistical reporting fora? 



r 



.VOTE: IMPORTyWT INSTRUCTIONS 

If the client's case file does not contain an R-300 or an 
equivalent form, proceed to Section II, page 7 to com- 
plete the section on evaluation of rehabilitation poten- 
tial. 

If the case file does contain an R.300 or its equivalent, 
please respond to all iteas in Section I, C* 



NOTE:. IMPORTANT INSTRUCHONS 

Respond to ite«s (d.r.) and (c*d*) usinf date inforaation 
€Ather*d frov'the case record. In the event the infor- 
■ation is not found in the case record^ use available data 
Srom the R-300 or its equivaleift. If the data is not re- 
corded (K/R) anywhere in the case file, fill in circle S 
in the far tight colusx* 

Then respond to the information items 20-58 by filling in 
the number in the answer column that indicates your 
findings relative to the agreement of data found on the 
R-300 (or equivalent) to that found in the case record, 
Ihe following is a delineation of potential responses 
and their definitions: 



1 • Verified; 

2 « Hot Verified; 

Case Record Only; 

4 • R-300 Only; 

5 » Not Recorded (N/R) ; 

6 » Not Applicable (N/A) 



R-300 data included and con- 
sistent with that found in 
case record 

R-500 dat.^ different from 
that fotmicf in case re cot d 

Data recprded In case 
record only, not on R-300 

Data recorded on R-300 only 
not in case record . 

Data not recorded in either 
case record or R-300 

Data not applicable to client 



/* tha follcuing infomation on the R'^ZOO, or its equivatant, aonaistent 
with that found in the actga record? 



(d.rj Date client was referred to state VR agency: 

/ 

(c.d.) Closure date: I I | I I | | [ 

^MO DAY YR 

20; The client's Social Security ntui^er 

21. The cllent'^SSDI status at referral 

22. The client's SSI status at referral 



^D ■ DAY 







Y 





154 



ANSWER COLUMN 



YES NO 



o u 



s 
o 



C3 



2S < 
2 Z 
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ERIC 



SECTION I: CASE INFORMATION 

C: R-300 V'^IFiaTION, continued 



Is th* following infomztion on tha }i^ZOO, ot its equival^t, consistent 
tjith that found in ths case r^oord? 



23. 
24. 

25. 
26. 
27, 

2S. 



The major (primry) disablinf condition 
Hie client's secondary disability 
The client's work status at referral 
The^'client'5 earnings the week prior to referral 

The client's receipt or non-receipt of public assylstance at referral . 
(Documentation of non-receipt would occur when the R-300 records no 
public assistance received and the case record provides no documen- 
tation of receipt.) 

The type(s) of public assistance received at referral 

a. SSOI 

b. SSUaged 

c. SSI-blind 

d* SSI-disabled 

e. AfDC 

f 

f . Other' (specify! . 



29. 
30. 



The monthly ajount of public assistance received at referral 

The length of time> prior to referral , during which the client 
received public assistance 



31. The appropriateness of the Federal Special Program identification 



ANSWER COLUMN 





checks 






a. 


Social Security Trust Funds (TF) 


® (D CD ® (D (D 




b. 


Veterans (VET) 


® (D CD ® (D (D 




c* 


Migratory Agricultural Workers (MAK) 


® ® ® ® © ® 




d. 


Offender (PC) 


® © ®,® © ® 




e. 


Work Incentive Program (KIN) 


® ® ® ® ® ® 




f. 


Expansion Grant Project (SEC4) , 


® © ® (4) ® ® 




g- 


Supplemental Security Income Funds (SF) ' 


® ® ® ® ® ® 




h. 


Severely Disabled (SO) 


® © ® ® ® ® 


32. 


The 


client's SSDI statOs at closure 


' ® ® ® ® ® 


33. 


The 


cUent's SSt status at closure 


® ® ® ® © 


34. 


The 


client's work status at closure 


® tD © ® (|) 


35. 


the 


client's weekly earnings at closure 


© © © ® © 


36. 


The 


client's receipt or non-receipt of public assistance at dosbrP. 





(Documentation of non-receipt would occur when the R-300 records no 
public assistance received and the case record provides no documcn* 
tation of receipt.) 



U4 > O 

> z cj o Z 



(D © CD ® © 
©©©©©© 
® © © ® © 
©©©©©. 

© © © © 



© © 

© © 

© © 

© © 

© © 

© © 

0 © 



© © 

© © 

© © 

© © 

© © 

© © 

© © 



© © 
© © 
© © 
© © 
© © 
© © 
© ©' 



© © ©' ® © ® 



© © © ® © 
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SECTiaV I; CASE INFORMATiaN 

•C: R-300 VERIFICATION, continued 



ANSWER COLUMN 



1$ tht followwg informticn on ' the R^ZOO, or iu tqidvaUnt, consUtent 
itith that found in the oase rtcotd? 



37. 



38. 



39. 



42. 

43. 
44. 

45. 

46. 



The type(s) of public assistance received at closure 

a. \SSDI 

b. I SSI-aged ' ^ / 

c. SSI-blind 

d. SSUdisabled 

e. AF^ 

f. Other (specify) ' 

The 0wnthly aaount of public, assistance received at closure 
TTie cUeht's Occupation at closure 

The correct DOT code for that occupation? (Check in Dictionary 
of Occupational Titles) 



41/. .1}ie 4^ent's outcoM status 



^ason for nonrehabilitated closure 
The total cost of all case services 

The total cost of all case services provided in rehabilitation 
facilities 

The total cost of case services diarged to Social Security Tjust 
Funds 

The total cost of case -services charged to Supplemental Security 
IncoM funds 



« u 

5 > 

u ^ 

s. i 



® © 
© © 
© © 
©..© 
© © 
© © 
© © 



o 

& ° 



© © 
© © 
© © 
© © 
<D © 
© ® 

© © 



© ® 

© ® 

© ® 

© ® 

© ® 

© ® 

© ® 
® 



® ® ® 

® ® ® 

® ® © 

® ® © 

® ® ® 

® ® ® 

® ® ® 



® ® 
®-® 
® ® ® 
® ® ® 

® ® ® 

® ® ®. 
® ® ® 
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SECTiaH I: CASE INTOWV\TION 

C: R-oOO VERIFICATION, continued 



SERVICES PROVIDED ITB! 


47 


48 


49 


SO 


51 


5? 


53 


54- 


ss 


56 


57 


58 


SERVICE 


























INSTRUCTIONS: Please answer 
the following questions (A 
and 8) for each of the ser- 
vice categories 47-SS listed 
at the right. 


u c 
^ o 


u 
c a 
o 

w (S 


a w 


u 

u 
m a 

>s c 
a u c 


1 School 
too 


a 


o 


« ^ O 


mcous 


0 
u 




a 

B 


a cs 


u ^ 


O M 
- ■ Q« 


< ^ 
c v 


O -) 


c 
a 


1 c 


^ c 3 

3 0 0 
C *^ w 


^ G 


a 
o 


w 
o 

u 


O U. U1 

U U 




&^ 


a VI c 


o o 


o 8x 


c o 


w o 


a w (/I 


e 


w 




M U O 




« m 

> 


w ^ e 




o c 

w ^ •« 


' ^ CJ 
( fA 
3 1^ 


c3 O 
U JZ 




V) M Si 

*• y 








> O .9 
Wi £ fi 






oe w : 




O tu S 


CO a 


o u 

> W) 


as 


o a 
ou > < 




a 




o o 
n O 


A. Indicate your findings, 
regarding the agreenent 
of data found on the - 
R-300, or its equiva- 
lent, to that found in 
the case record relative 
to the client's receipt 
or non-receipt of the 
following services. 


• 

L 
























Verified 


®' 




® 


® 


© 


©. 


© 


© 


© 


© 


© 


© 


Not Verified 


(D 


® 


® 


® 


© 


© 


© 


© 


© 


© 


© 


© 


Case Record Only 


(D 


(D 


® 


® 


© 


© 




© 


© 


© 


© 


© 












© 








© 


® 




® 


N/R 








© 


©. 


(s5 

L ^ 


© 




© 








N/A 




® 




<6) 




vS/ 






© 








B. Indicate your findings 
regarding the agreement 
of data found on the 
R-300, or its equiva- 
lent, to that found in 
the case record relative 
td the cost statxxs of 
the following services. 










• 














• 


Verified 


® 


® 


® 




® 


© 


© 


© 


© 


© 


© 


© 


Not Verified 


® 


® 


® 


® 


@ 


© 


© 




© 


© 


© 


© 


Case Record Only 


(D 




® 


® 


© 


© 


© 


© 


© 


© 






R.500 Only 


® 


® 


®" 


® 


© 


© 


© 


© 


© ■ 


© 


© 


© . 


N/R 




© 


© 


© 


© 


© 


©^ 


© 


© 


© 


© 


© ; 


N/A 




© 




© 


© 


© 


© 


© 


® 


© 


© 


© • 
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Exhibit^ 9 (contO 



(10) 
(10) 

(10) 
(10) 

CIO) 

(10) 
0) 
(10) 

(10) 
(0) 



SECTION II: EVALUATION OF REHABILITATION POTCNTIAL 

A. PRELIMINARY DIAGNOSTIC STUDY — STATUS 02 



Fortquestlons 4 throush 11, please answer with: 

1 « YES - 

2 • NO 

3 » NOT APPLICABLE (N/A) 



Oo€9 thB prttvntnary diagnoMtia Mtudy . . . 

4. Include 'an appraisal of the current general health status of the client? 

5. include a psychiatric or psychological exanlnation In all cases of 
ntntal or enotlonal disorder? 

6. include such exajti.natlons and diagnostic studies sCs necessary to: 

a. determine eligibility? 

b. deteraine the nMd for extended evaluation? 

7. place priaary eaphasis upon the determination , of the client's potential 
for achiil^ng a vocational goal? 

8. support m% dttendmition that the client Has a aedically recognized 
\physica^or mental disability? 

9. support the determination that the medically recognized disability 
consittutes a substantial handicap to employment for the client? 

10. support the determination that VR services may reasonably be expected 
to benefit the client In terms of en^loyability? f 

11. support the determination that an extended evaluation is necessary to 
determine that VR services may reasonably be expected to benefit the 
client in terms of eMployability? 

12./ contain data Supporting a determination that the client is severely 
disabled? 



NOTE: IMPORTANT INSTRUCTIONS 

If case is certified eligible for extended evaluation, go 
to Section II.B.» question >14, page S.to coaplete sub- 
section on Extended Evaluation. 

If case is certified eligible^ go to Section III, ques- 
tion 1» page 12, to complete section on Eligibility. 

If caM data does not support the determination that the 
client is eligible, although the client is certified as 
suchr; set case aside io-t review by full review team. 

If case is closed in Status 08, go to Section VII, page 19 
to complete the appropriate subsection on Status 08 
closures. 



ANSWER 
YES NO N/A 



® 


- (D 


© 


CD. 




© 


® 




© 






© 




© 


© 




© 


© 




© 


© 




© 


© ' 




© 


© 


® 


© 


, © 
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9 


SECTION 11: 
B. 


EVALUATiaN OF REHABILITATION POTENTIAL 
EXTENDED EVALUATION — STATUS 06 
1 


• 


YES 


NO N/A 






















\ 

For items 14 through 42, please answer with: 














1 • YES 














2 » NO 


/ 












3 « NOT APPLICABLE (N/A) 












Certification for Extended Evaluation 












Do€9 the ca»€ record . * 








(10) 




14* contain a certification for extended evaluation to determine 
rehabilitation potential: 


viz 


(2) 






If IKS, 


do98 tht G^rtifioation far ext^ndad evaluation . . . 






(10) 




a. indicate the date of certification? 




® 


® 






» 

Individualized Written Rehabilitation Program (IWRP) for Extended Evaluation 






(12) 




18. Is th«re an IWRP for extended evaluation in the case 


record? 


® 


® 








NOTE : • IMPORTANT INSTRUCHONS 


> 












If there is IWRP for extended evaluation 
in the case record, answer questions 19 
through 42 below.- 






• 








'If there is no IWRP for extended evaluation * 
in.'the case record, go on to question 43, 
page 11. 












' thQ IWRP for gxUnlad evaluation ($'taU form) » . . 








(10. 


12) 


. 19. present the general basis for- a determination that an extended 
evaluation of rehabilitation potential is necessary to^jnake a 
detemdnation of ellgiblllt/? 

20. set forth the terns and conditions for the provision of service, • 
including: 






(12) 




«t 

a. client responsibilities in carrying out the program, such as 
attendance, cooperation, etc.? 


® 


® 


(12) 




b. the extent of client participation in the cost of services? 


® 


® 


(D) 




c. the extent to which the client is eligible for similar benefits , 
under other programs? 


® 


® 


(0) 




d. the availability of VR funds? 




® 


® 


(l>) 




e. the availability of openings at facilities and schools? 


® 


® 


(0) 




f. the possibility of delay in a phase of the program? 


® 


® 


(D) 




• g. the provision for changes in the program due to new information 
and Changing conditions? 


® 


© 
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SECnaN II: -EVAUJATIONi OF REHABILITATION POTENTIAL > f ^ 
B. EXTEJiOED EVALUATION — STATD$ 06, continued 


.YES 


ANSWER 
NO 


VA 


3oe$ th9 IVJtp for extended ev^uatibn f « . . 






- 


21. 


document tKkt the c^Uerit, was informed of client rights and remedies, 
including: • , ' • 










a. ^ the right to be fully consulted regarding 'any changes or 
anendments in the' rehabilitatipn program? 










b.^ thh right to. adinihistrative review in case of dissatisfaction 
„ with services? . • . ^ 




© 




• 


c.Jf the availability of xesources within the olient assistance 
project/ where appropriate? 










d. * the right to participate in die annual review of the program? 




- © 






* ' • \ ^ 
$f "the ris^t to participate in the annual ^review of the ineligi- 
bility decision? 




® 




22. 


' reflect i*Jtat the IlfRP for extended evaluation was maintained as a 
' separate ;^art of the case record? ' 


® 


® 




23. 


show that 'the client received a copy of the IWRP and substantial 
amendments? ^ . • - ^ / 


® 


® / 




24. 


show that the progz'am was initiate/i after the certification for 
extended evaluation? 


Q 


® 


\ 


26. 


indicate ,that the program was developed and amended with the client's > 

participation, or as appropriate, with the parent, guardian, or 

other representative? ' . . 


Q 


® 


X 


28. 


sta^t^he intermediate rehabilitation objectives? ^ 




® • 




29. 


state the VR services to be provided which are necessary for the 
deterrsin.'.tion of rehabilitation potential? 


® 


® 




30. 
31. 


contain the projected da.te.fbr the initiation of each service? 
contain^ the anticipated duraticm^ for eadt service planned? 


® 


•®' 
®^ 




32. 


provide the projected 'time within which rehabilitation objectives 
nay be achieved? 


(D 


® 




33. 


show that a thorough asiiessment of the client's progress was made at 
least once in every 90-day period during the provision of services 
under the extended ev^uation? ^ 


® 


/ 

@ 


® 


34. 


state the objective criteria upon which, an ^valuation of the clJLent's 
progress is based? ^ ^ v 

state the procedure by which the client is evaluated? 




® 




35. 




® 




36. 


contain a schedule for the peri^ic re^^fews and progress evaluations? 


® 


® 




37. 


contain a recozd .of the results of scheduled reviews and progress 
evaluations? 1 


Q 




* 


38. 


.show that a formal, annual review has been conducted if the INRP has 
achieved at least first anniversary status? 


Q 


© 


Q 


39. 


document the client's views, or, as appropriate, the views of the 
parent, guardian, or other representatives concerning the objectives 
and VR services being provided? 

# 


0 


a 


« 
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(10, 12) 

(12) 

(12) 
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SECTiaN II: EVALUATiaN OF REHABILITATION POTENTIAL 

B. EXTENDED EVALUATION — STATUS 06", continued 



NOTE: IMPORTAm" INSTRUCTIONS 

If the client has been determined eligible as 
a result o£ extended evaluation, answer que$< 
tion 40. 

If the client has been detemined ineligible 
as a result o£ extended evaluation, answer 
question 4Z. 



d099 the oa»9 rtcord • « • 



40. contain a certification of eligibility for the continuance 
of VR services? 

DoB9 tha IWRP for eztandad evaluation . . : 

42. contain a closure statenent as an aaendoent to the program for the 
client determined ineligible because of a lack of rehabilitation* 
pountial? 

If TSSi do€9 ths COM record . . . 

a* show that the decision to teniinate services was made in full 
consultation with the client, or as appropriate, with the 
parent, guardian, <Jr other representative? 

b. show that the rationale for the decision to temdnate services 
was recorded as a certified aiaendment^to the IWRP for extended 
evaluation? 

c. show that a certification of ineligibility was then executed? 

d. show that the provision was made for a periodic review, at 
least annually, of the ineligibility decision? 



ANSWER 
YES . NO N/A 



® ® 



(D ® 



(D 
® 



CD @ 
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SECTION II: EVALUATiaV OF REHABILITATION POTEKTIAL 

B. EXTENDED EVALUATION — STATUS 06, continued 



DELH'ERY OP SERVICES 


ITEM 


43 


44 


45 


46 


47 


48 


49 


SO 


SI 


S2 


S3 


S4 


SERVICE 






s 








• 








(A 
<») 




INSTRUCTIONS: Please 
answer questions B, C, 
and E for each of the 
service categories 
listed at the right. 




;tic and 
1 Services 


c 

o 


il Rostorutio 


Restoration 


•a 54 

c s 
o 

c 

C > 


o 
u 
s 
m 


•c 
o 

C3 
♦i* 
U 


V 

X 

0 


o c 
u 

> 

o a 

•a V 
N -3 a 


nunicutions 


Lonal liccnsi 
Bquipioont 


c 

ss 

(A 
O 


B. Does the case record 


o o 

&s 

^ o 

Q ac 


Counsel 
Guidanc 


Physlcn 


Mental 


-Vocatio 
Other T 


Main ton 


o 
a. 

V) 

<3 
U 

Cm 


Servico 
Ponily 


H-i aj ^ 
o > 
V u u 

CUJO o 

« « 


O 

o 


Occupati 
Tools. 1 


Other O 
Service* 


doctuaent that the service 
was planned for the 
client? 




























Yes 


® 


© 


© 


© 


© 




® 


© 


©■ 


© 


© 


© 




No' 




© 




© 


© 


(D 




© 


© 


© 


© 


© 


uoes znt case record 
docuaent that the ser* 
vice was given. to the 
client? 


























1 


Yes 


® 


© 




-© 


© 


® 


® 


© 


© 


© 


© 


© 




No 




© 


© 


© 1 


© 


(D 


® 


© 


© 


© 


© 


© 




N/A 


© 


© 


© 


© 


©. 


® 


® 




© 


© 


© 


© 


If yes. 




























E. Was full consideration 
given to any similar 
benefits available to 
the client to neet» in 
whole or in part, the 
cost of the service? 




























Yes 


© 


© 


© 


© 


© 


® 


® 


© 


© 


© 


© 


© 




No 


© 


© 


© 


© 


© 






© 


© 


© 


© 


© 




N/A 


© 


© 


© 


© 


© 


® 


®. 


© ■ 


© 


© 


© 


© 



NOTTI: IMPORTANT iNSfRUCTl'ONS^ 

If the case is certified eligible, go to Section III, question 1, 
page 12, to completesection on Eligibility. 

If case data does not support the determination that the - 
client 'is eligible although the client is certified as 
such» set case aside for review by full review team. 

'if case is closed in Status 08, go to Section VII, page 19, 
to complete the appropriate subsection on Status 08 
closures. ^ 
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SECTION^ III: ELIGIBILm — STATUS 10 



(10) 

(10) 
(10) 

(D) 



(10) 
(D) 



(D) 



(0). 
(10) 



For question 1, please answer with: 

1 « YES 

2 « NO 

3 « NOT APPLICABLE '(N/A) 



Do9$ tha cats record ... 

1. contain a certification of eligibility? 

If TES, do9$ th€ aertification of eligibility ... 

a. indicate the date of certification? 

jc. Indicate that the client has net the basic eligibility 
requirements? 

2. contiin data supporting a determination that the client is 
severely disabled? 



For questions 3 through 8, please answer with: 

1 « LESS THAN ADEQUATE 

2 s ADEQUATE 

5- » NOT APPLICABLE (N/A) 



Physical or Mental Disability 

Bcw W€ll do€€ th9 aounselor doaumtntation in thm aasa v€cord . . . 

3. establish the presence of a physical or mental disability with 

nec< *tsary ntdicaX, psychiatric, psychological, and other information: 

4. show that the physical or mental disability materially limits, 
contributes, to limiting, ^r if not corrected, would probably result 
in limiting a client's activities or functioning? 

Substantial Handicap to Enployment 

Bou wall do€9 ths ocwlor doownantatian in tha cote raaord ... 

5. analyze the specific ways in which the following factors, as ^pro- 
priate to the client, impede the client's occupational performance 
by preventing the client from obtaining, retaining^ or preparing 

for employment consistent with the client's capicities and abilities? 

a. medical factors? 

b. psychological factors? 

c. > vocational factors? 

d. educational factors? 

6. show that the related factors which boar upon successful vocational 
participation were considered? 

show that the substantial handicap~to employment exists, even though 
the cl/ient is employed, because the client is unable to obtain a 
gainful occupation consistent with the client's capacities and abilities? 



ANSWER 
YOS NO N/A 



® (D 

® (D 

® (D 

® ® 



® ® 
Q ® 



® 



® 


• ®- 


® 


® 


® ■ 


a)- 


® 


® 


® 


® 


® 


® 


® 


®' 


® 



® © ® 



iG3 



ISl 



Exhibit 9 (cont.) 



(10) 



\ 



SECTION III: ELIGIBILm STATUS 10, continued ' 




ANSIfER 




YES 


NO N/A 


Reasonable Expectation 




Hou wBll d099 the aounselor dooumentation in the case record . . . 






8. show the likelihood of VR services enabling the client to achieve 

vocational goals consistent with the client's capacities and abilities? 


0 
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u 



SECTiaM IV: BVALUATiav OF REHAB ILITATiaM POTENTIAL -HIROUGH 
DIAGNOSTIC STVDY — STA7||^ 02 AND 10 



Doet the .thorough diag7i09 tic 8 tiddy 

1. deteraine the nature of VR services « needed by the client? 

2, deteraine the scope of Vft services which are needed to attain the 
vbcational goals of the client? 

S. consist of a comprehensive evaluation, to the degree needed, of 
pwinent medical, psychological, vocational, educational', and 
o»er -related factors which bear on the client's handirap to 
eaploynent? 



ANSWER 

♦yes no n/a 



® (D 
® 0) 

CP ^ (D . .- 



165 



153 



Exhibit 9 (cont.) 



IS 



(12) 



(12) 

(12) 

^12} 

(0) 

(0) 
(0) 

(0) I 

(12) 
(12) 

(0) V 

(12) 
(12) 

(12) 

02) 



SECTIOH V. INDIVI0UALi:2D HRITra REHABILITATION PROGRAAf (IWRP) 
STATtJS 12 AND ABOVE 



For questions 1 through 23, please answer with: 
* 1 • YES 
2 « NO 

5 » NOTAi>PLICABLH (N/A) 



1. Is there? an IKRP in the case rscord? 



NOTE: IMPORTANT INSTRUCTIONS 

If there is an IKRP in the case record, answer questions 
2 through 23 below. 

If there is no WRP in the case record and services are 
being provided, go to Section VI, page 13. 

If there is no IKRP in the case record and no services 
are being provided, go to Section VII, page 19. 



Do€9 th0 Dft(P (8taU form) . . / ^ 








2. 


prtaent the general basis for a dttenination of eligibility? 


0 






3. 


set forth the terms and conditions for the provision of services, 
including: 










a. 


client responsibilities in carrying out the prograa, such 
as cooperation-, attendance, etc? 


(D 








b. 


the extent of client participation in the cost of services? 


® 








c. 


the e;5tcnt to which the client is eligible for similar benefits 
under other programs? 




® 






d. 


the availability of VR fundsT' 




® 


® 




e. 


the availability of openinp at facilities and schools? 






® . 




f. 


the possibility of delay in a phase of the prograa? 




® 


® 


4. 


document that the client was inforaid of client rights and remedies, 
including: 










a. 


the right to be fully consulted regarding any changes or 
aaendaents in the rehabilitation progran? 


® 


- ® 






b. 


' the right to adninistrative review in case of dissatisfaction ' 
with services? ^ / 


(D 








c. 


the availability of resources within the client assistance 
project, where appropriate? \ > ^ 


® 


® ' 


® 




d. 


the right to parti'cipate ,in the annual review of the program? 


© 


® 






e« 


the right to participate in the annual review of the 
ineligibility decision? 


(D 


® 





reflect that the IWRP was oaintained as a 'Separate part of the 
case record? 

6. show that the client received a copy of the IWRP and substantial 
amendments? 



ANSWER 
YES NO N/A 



® ® 



(5. 
® 



® 

® 
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SECTias V. INDIVIDUAL! ::ed mirm rehabilitation program (iwrp) 

STATUS 12 AND ABOVE, continued 

J^' 



YES 



ANSWER 



N/A 



(D) 
(12) 

(12) 

.(12) 
(12) 
(12) 

VZ} 
(12) 
(12) 

(12) 

(12) 
(12) 
(12) 

(12) 



Does she DfEP (state form) ... 

7. show that the pro^graa was initiated after the execution of the 
certification for eligibiUty? 

9. indicate. that the prograa wis developed and aoended with the client's 
participation or, as appropriate, with the parent, guardian, or other 
representative? 

11. place priiaary emphasis on the determination and achievement of a 
vocational, goal? ^j, 

12. state the long-r,ange ein)loy6ent goal? 

13. state the intemediate rehabilitation objectives? 

14. state the specific VR services to be provided to achieve the inter- 
oediate objectives and the enployment goal? 

15. contain the projected d*te fo3f the initiation of each service? 

16. contain the anticipated duration for each service planned? 

17. provide the projected tiae within which rehabilitition objectives and 
goals may be achieve? 

"IB. state the ob jectivtvariteria upon which an evaluation of the client's 
progress toward an enplo/ability goal is based? 

19. state the procedure by which the client is evaluated? 

20. contain a schedule for the periodic reviews and progress evaluations? 

21. contain a record of the results of the scheduled reviews and 
evaltjations? 

22. show that a formal, annual review has been conducted, if th^ IWRP has 
achieved at least first anniversary status? • 

23. document the client views, or as appmpriate, the views of tne parent, 
guardian, or other representative concetning the goals, objectives, and 
VR services being provided? \ 



NOTE: IMPORTANT INSTRUCTIONS 

If case is closed non-rehabilitated, answer question 24 

If case is closed rehabilitated, an5wer question 25. 

If case is closed rehabilitated and po'st-empl^oyraent 
services have been planned, answer question 26* 









® 




(2) 


® 


(D 


® 


® 


G) 


(D 


® 


(D 




(D 


CP 


(D 








(D • 


® 


(D 


® 






(D 



(D 
(D 



(12) 



(12) 



Doea th$ XWR? ... 

24. contain a closure statement is an amendment to the program when the 
case is closed non-rehdbilitated because the client is not capable 
of achieving a vocational goal? 

// YES, doea the case record » . . 

a. show that the decision to terminate services was made in full 
consultation with the client, or, as appropriate i with the 
parent, guardian,, or other representative? 



CD (D 
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(12) 



(12) I 



(12) 
(12) 

(12) 

(D) 

(12) 

(D) 

r 



SECTION V. INDIVIDUALIZED WRITTEN REHABILITATION PROGRAM (IWRP) - 
STATUS 12 AND ABOVE, continued 


* YES 


ANSWER 










24. continued ' 








b. show that the rationale for the decision to terminate services 
was recorded as- a certified aMndnent to the IWRP? 




(D 




c. show that a certification of ineligibility wu chen AxuiniriU? 


® 


© 




d. show that the provision was aide for a periodic review, at 
least annually, of the ineligibility decision? 






2S 


. contain a closure stateaent ^s an a»tndji«i.t, tQ the program for a case 
dosed rehabilitated? 


® 


© 


It 


TBS, do0s e/se 5tat«Mflt iociude: 








a. ^ description of the basis unon whif^h rhm ^Wmnr timm AMT^^tmi ii-a-i 

to be rehabilitated? 


® 


• 

© 




e. any plans for the provision of post-enplbyment services after 
a suitable objective has been achieved? 




© 


26. 


Is there an awnded. DffiP for Post-Eaployment Services? 




© 


X£ 


YES, dP9M C/s* Mmmod^d XHKP . . . 








a. provide -the basis on which plans for post.e«ploy»ent services 
have b«tn developed? 




© 




b. describe the outcome to be achieved or the outcome of post- 
eaploywent services? 




© 




c. describe the type and extent of post-euployment services to be 
or being provided? 




© 
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' 

SECTION VI. DELIVERY OF SERVICES — STATUSES 14. 16, 18, 20, 22, ANlf 32 



ITEM 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


n 


12 


13 


14 


SERVICE 


c 




e 


e 

0 










u o 

VI 


VI 

e 
o 


VI 

e 
o 








INSTRUCTIONS: Please answer 
questions B,C,F,and G for each 
o£ Che service categories 
(Items 1-U) listed at the 
right. 




s c 
ej V- 

e ^ 
0 ^ 

W V 

a c 

3 C 


e 

19 
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o e 
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(3 
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u 
0 

V) 

u 
ae 

a 


? c 
e 

fl u 
O E- 


o 

u 
s 

c 
u 

e 


o 

a 

u 
o 

Q. 

M 


Services to the 
Family 


3 § 

a • 

o a 


— < 

3 
3 

m 

O 

u 
o 


o ^ 

•J i> 
e 
c. 

e 3 
o c 
^ u 

<« • 

& VI 
3 -* 


er Goods and 
vices 


i 
« 

CI 


r 

o 

g* 

m 
f 






-« c 
e* e 
> 


< e -3 


V) 
>* 

jC 


c 

it 


a o 

u «c 
o 

> o 




(3 






II 


O C/3 


eg 
a. 


o 
a. 


B. Does the case record 

docuaent that the service 
was planned for the client 






























Yes 


® 


® 


CD 


Q 


® 




© 




© 


© 


© 


© 


© 


© 




No 






CD 




® 


© 


© 




© 


© 


© 




© 


© 


C. Does the case record 

docuaent that the service^ 
wa^ given to the client? 
































Yes 


® 


® 


G) 


® 


® 


® 


© 


© 


© 


© 


© 


© 


CD 


© 




No 


(D 


(D 


® 




® 


© 


® 


© 


© 


© 


© 


© 


ci) 


© 


N/A 


(D 


(D 


CD 


® 


® 


© 


© 


© 


© 


© 


© 


© 


© 


© 


If YES, 
































F. Was the service provided 
consistent .with es^ployTBent 
at closure? 

Yes 




® 




Ci) 








© 








© 








No 


(D 


CD 


CD 


CD 


®- 


© 


C^ 


© 


© 


© 


CD 


© 


'© 


© 


N/A 


CD 


CD 


® 


® 


® 


® 


® 


© 


© 


© 




© 


© 


© 


G. Wa5 full consideration 
given to any similar 
benefits available to 
the client to meet, in 
whole or In part, the 
cost of the service? 
































Yes 




CD 


® 


® 


® 


2) 


® 


© 


© 


© 


® 


© 


© 


©' 




No 




CD 


® 


CD' 


® |< 


© 


® 


© 


© 


© 


® 


© 


•© 


© 


N/A 


CD 


® 


® 


® 


® ( 


i) 


® 


© 


© 




® 


© 


© 
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SECTION VII: 



TERMINATION OF CVSES — STATUS 08 FROM OOm 
INTERV'ENING REASONS , 



ANSWER 
YES NO N/A 



NOTE: DlPORTAm' I?4STRUCTI0NS. , 

Please proceed co the appropriate subsection according co 
the cose. status at closure as indicated below. If the 
case is in an open status, go on to Section VIII, page 27. 

If the case is closed in Status 08 from Status 00/02^ for 
intervening reasons answer questions 2throughS, page 19 

If the .case is closed in Sta.tus 08 from Status 00/02 due - 
to ineligibility, answer questions 6 through 16, page 20. 

If the case is closed in Status 08 from Status 06, answe^ 
questions 17 through 27, page 21. 

If the case is closed in Status 30 or Status 28, answer 
questions 28 through 41, pages 22 and 23. 

If the case Is closed in Status 26, answer questions 42 
through S8, pages 24 through 26. 



For 'questions. l^^j^TOugh 5, please answer with: 
1 - YES - 
- . 2 * NO 

3 - NOT APPLICABLE (N/A) 



* Intervening reasons i»tans.',th»t client becomes unavailable 
for interview, evaluation^ and diagnostic studies, or other 
services essential for mai(ing'4ligtbilit//ineligibility 
determinations because the client died, laoved out of state 
or was i^>ossibl>e to cpntact, or was institutionalized 
under circuastances th^t rendered jthe^lient unavailable^ 

' ■ " ' ^, 



Case Closed Status 08 from' 00/02 Intervening^ Reasons 

0 

Does t/ie CMM0 racocd . . . 

2. document specific reasons for the closule action? 

If YES, domM Che case record docnmnt thMt the climnt bmcMnm , 
unMvMil4bi^ for infrvimt, •vMluation, and diMgnsszic studies, 
or othir services essential for making •libigiXity/ ineligibility 
determinMCions because th§ client: . ' 

z\ died? 

b. ' ooved out of state or was impossible to contact? 
t\ /^^s' institutionalized under circumstances which rendered the 



cl'jlent Unavailable 



rcu^stqncc 



show that the ciont was referred to other agencies and facilities, 
as apprc/^riate? 

>• 

show that the action taken and outcome were reported to other 
agencies, as appropria.te? < 

show that the client, or as appropria<S^.'*CTfi parent,' guardian, or 
other representative^ was advised of the reasons for closun and the 
closute action taken? ^ ; ^ 

00 ON TO SECTION VI 11, PACE 27. 



0 


CD 












© 
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■ . a; 



X 



CD (2) ■ 

J ' ■ ■ 
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SECTION VII: TERMmTIOM OF CASES STATUS 08 FROM 00/02 — 
INELIGIBILITY 



(10) 

(10) 
(10) 
(10) 

(10) 
UO) 

(10} 

^10) 
(10) 

(10) 
(10) 

(10) 
(0) . 

(10) 

(10) ' 

(0) 

(0) 



For questions 6 through 16 


please answer with: 


1 » YES 




2 • NO / 




3 « NOT APPLICABLE 


(N/A) 



Case Closed Status 08 froa ^0/02 rneliglbility 
Does th» CMS4 record ... 

6. contain a certification of ineligibility? 
1/ YSS, does the certificmtion of ineligibility . . 
a, indicate the date of certification? 

c. include the reasons for the detemination of ineligibility? 

7. show that the client does not have. a. medically recognized physical 
or nental disability? 

8. show that the client do«s not have a substantial handic^ to .employment?' 

9. show that beyond any reasonable doubt the client is not expected to 
^ benefit in terns of eaployability fron VR services? 

10. contain data supporting the ineligibility det^rrminatioii^, including 



a. a sunary of pedical and other case data obtained^duriivg the' 
preliminary diagnostic study? * /, / ' 

b. an analysis specifying the reasons for the ineligibility determination? 

d. docuiDentation of a review of the ineligibility detenal^^tion not later 
than 12 aunths following «such determination? 

11. show thitthe ineligibility dt termination was made only after full consu^* 
tation wi^ the client, or as app^riate, with the parent, guardian, or^ 
other representative? 

- 12 « document that the client was notified in Writing of the closure action 
taJcen? * ^ ^ 

13. document that the client was informed in writing of client rights and 
remedies* including: 

s 

' ' a. the right to administrative review and fair hearing?. 

b. the availability of resources within the client assistance project, 
where appropriate? ' ^ ' 

c. the 'right tqJparticipate in the annual review of the^ ineligibility 
deterudnatiort? . ^ . ' = 

14. document any actli^n and decision involving the client's request for on # 
administrative review of z%wfty action or fair hearing? / 

15. ^how that the client was referred to other agencies. and facilities, as 
appropriate? •* 

16. show that the action taken scid outcome were reported to other agencies, ' 
' as appropriate? 

i 

CO ON TO' SECTION VIII, PAGE 27. 



ANSWER 
YES NO N/A 



CP 


(2) 




CD 


(D 




® 


(D 




® 




'CD 




.© 


® 


® 


(D 


(D 




CD 




® 


(D 










® 






CD' 


® 


CD- 




CD 


CD 






\ CD 
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CD. 






CD . 
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CD 


CD 




CD 
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SECTiaS vri: TERMINATION STATIiS 08 FRttM 06 — INELIGIBILITY 



(10) 

(loj 

(10) 
(10) 

(D) 

(Id/ 12) . 

r: 

(12) " 

(10) 

(10) 

(10) 

(D) 

(D) 



-fop questions 17 through 27, please answer with: 

1 • YES ' 

2 » NO 

3 » NOT APPLICABLE (N/A) 



ANSWER 

NO N/A 



YES 



Case Closed Status 08 from 06 Ineligibility 

17. contain a certificaUon of ineligibility? 

If YES, does thm cmrtific^tion of inmligibHity ... 
a. Indicate the date of certification: 

c. .include the reasons fbij the detemination of ineligibility? 

18. show that beyond any reasonable doubt the client cannot be expected to 
benefit in terms of eaployability from VR services?- ' 

li. show that the iftterruption of services precluded the continuation of 
the .iWRP for extended evaluation? 

20; contain the rationale for the ineligibility determination as an 
. amendment to the IKRP? 

21. Show that the ineligibility determination was made only after full con- 
sultation with the client, or as appropriate, with the parent, guardian, 
or other representative? 

22'. show that the IHRP contains the views of the client, or as appropriate, 

the parent, guardian, or other representative concerning the ineligibility 
determination? 



23. 



24. 



document that the client was informed in writing of the closure action 
taken? 

document any action and decision involving the client's request for an 
administrative review of agency action or fair hearing? 



25. document that the ineligibility determination was reviewed not later 
than 12 months follovint such determination? 

26. show that the client was referred to other agencies and facilities, as 
appropriate? 

27. show that the action taken and outcome were reported to other agencies, 
as appropriate? 

GO ON TO SECTrC»l VIII, PAGE 27. ' 



® 


(D 




CD 






® 


(!) 






(D 


0 


(D ■ 


0 


0 




0 




® 


0 


0 


0 


0 - 

f 


0 


(D 


© 




(D 


0 


■ 0 




0 


0 




0 


0 


0 


0 
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SECTION VII: TCRMINATION OF^ CASES — STATUSES 30 and 28 — 
NOT REHABILITATED ' 



\ 



(10) 

(10) 
(10) 
(D), 
(D) 

(D) 
(D) 
(D) 
(D) 

(D) 

(10, 12) 
(10, 12). 

(10) 
(10) 

(10) 
(10) 

(10) 
(10) 



For questions 28 through 41, please answer with: 

1 » YES . 

2 * NO 

3 « NOT APPLICABLE (N/A) 



Case Closed Status 30 or Status 28 Not Rehabilitated 

DomM chm cAse record . • . 

23. contain a certification of ineligibility? 

If YES, dams tbm ctrtification of iimligibillty ... 

a. indicate the date of certification? 

c. ''include the reasons for the detexisi nation of ineligibility? 

29. show that suitable eaployment cannot be achieved? r' 

30. show, that e«ploy»ent resulted without benefit derived fro« VR services? 

31. docuiatnt that one of the following situations necessitated closing 
the case as not rehabilitated? 

* ' a. the client decided not to follow through? 

b. contact j^was lost with the client? ' 

c. there was new information or cosiplications? 

32. document that when there was new infoimation or complications, the client 
was referred to another agency, as appropriate? 

33. docuaent that when the client aoved to another state, effort was made 
to continue or arrange VR services? 

# 

34. contain the rationale for the ineligibility determination as an amendment 
to the program? (Fort case closed Status 30 from Status 10, answer N/A.) 

35. show that the ineligibility detexitination was made only after full con- 
sultation with the client, or as appropriate, with the parent, guardian, 
or other rcpresdntative? 

36. document that the client was notified in writing of the closure action 
taken? ^ > 

37. document that the client was informed in writing of client rights and 
remedies? (For case closed Statu? 30 from Status 10, answer N/A.) 

If YES, do9S ehm case record show thMt the client wmm^ informed in 
writing of ^ , . 

0 

a. the right to administrative review and fair hearing? 

b. the right to participate in the annual review of the ineligibility 
determination? ^ 

38. document any action' and decision involving the client's request for 
an administrative review of agency action or fair hearing? 

39. document that the determination that the client was no longer eligible 
was reviewed not later than 12 months following such determination? 



ANSWER 
YES NO N/A 
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Exhibit 9 (cont.) 





SECTION VII:- TERMINATiaN OF CASES — STATUSES 50 AND 23 — ' 
• NOT REHABILITATED, continued 


YES 


ANSWER 
NO 






Doms chm cms0 record . • . 








(0) 


40, .show that the client was referred to other agencies and facilities , 
• as appropriate^ 


(D 


(D 


(D 


(0) 


41 • show that the action taken and outcome were reported to other agencies, 
as appropriate? 


0). 


(D 


(D 



GO TO SECTION VIII, PAGE 27. 

> 
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Exhibit 5 (contO 



SECTION, VIIc TERMINATION OF CASES STATUS 26 



(0) 

(D) 

(D) 
(D) 
(D) 

(D) 

(D) 

(D) 

(D) 
(D) 

(D) - 

(B) 



(0) 
(D) 
(D) 



For questions 42 through 51 please answer with: 

1 » Y£S 

2 « NO - * , , 
t « NOT APPLICABLE (N/A) 



Case Closed Status 26 - Rehai?ilitated ^ 
tiofM thm cMsm record i . . 

42. contain a closure statement as an ajnendement to the INRP? 
If YSS, doms the atMteamnt include; 

a. a description ofihe basis upon which the cliejjt tras determined 
to be rehabilitated? . ^ 

b. 'he type of occtxpation? 

c. the length of tine the client has been engaged in the occupation? 

d. a description of why it is determined that the client has made a 
satisfactory adjustaent? 

•. 'any plans for the provision of post-eaployment serviced ^.^t^r a 
suitable objective has been achieved? 

44. show that the- client was provided wl^th appropriate VR services in accord- 
ance with the IWRP? 

45. show that the client has completed the total program of services as 
described in the client's rehab i'litation program, including amendiaen ts? 

46. shov that the client has been placed in eaployaent consistent with the 
employment objective for which services have prepared the client? 

47. show that the suitable employment objective achieved by the client has 
been maintained for a minimum o^ 60 days? 

48. docunent that the client was informed in writing of ^ the closure action 
tak«n? ' / . 

» 

^49. 'show that the action taJcen and outcome. were reported to other agencies^ 
as appropriate? 

SO. show that the client was referred to other agencies and facilities, as 
appropriate? 

SK show that as part of the process of being determined rehab ilitated» the 
client was infonped . . . 

f . of.eligibiiity to receive necessary post-employment services? 

b. df the purpose for such post-enployment services? 

c, of any plans for .«such post-employment service^ 

d* ^ that the client should contact the counselor, especially during 
the first year following the determination as rehabilitated, 
before leaving the job, or if problems arise jeopardizing the job? 



XES 



ANSWER 

NO N/A 
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SECTION VII: TER.MI^ATIOM'OF CASES STATUS 26 



LESS 



ANSWER 
ADEQ. 



For questions 52 through 58, please answer with: 
1 • LESS THAN ADEQUATE 
s 2 » ADEQUATE ' 
' 3 • NOT APPLICABLE (N/A) 



/ ■ 

MOV waii does tht counselor docunmntation xn the case record ... 

52. show that there is a relationship between the services rendered and 
the vocational outcome? 

53. show that substantial services (those having a discernible impact on 
the client's enployabiXity) were rendered to the client? 

54. show that substantial placenent services were provided '^to the client 
toward the acquisition of a suitable occupation, including: 

a. an evaluation of the client's job readiness? 
c. instruction in making job applications? 

. d. .instruction in client conduct during interviews? 
t. employer contact? ^ 

h. consultation with •wployers or supervisors, as required? 

i. efforts in^ the area of selective placement' if the client is 
severely disabled? 

55. show that the following conditions of a suitable placement have been 
met, insofar as possible: 

a* the client and the en^Ioyer are each satisfied? 

b. the client is i2M»ntaxning adeqate interpersonal relationships? 

c. the client i5 maintaining acceptable behavior in the job environment? 

d. ' the occupation is consistent with the client's capacities and 

abilities, considering the client's choice? 

e. the client possesses acceptable skills to perform or continue 
the work satisfactorily? ' 

^ f. the employment and working conditions will not aggravate the 
client's disability? 

g. the client's employment situation will not jeopardize the health 
or safety of the client or others? 

h. the employment is regular and reasonably permanent? 

1. the client receives a wage commensurate with that paid others for 
similar work under legal requirements? 





(D 
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Exhibit 9 (cont.) 



26 



SECTIOH vrr. -rewaNATiaN of cases status 26. continued 



Hov t/mll dOBS the counsmior documnt^tion in the casm record . . 

36. support the reason and justification for closing the case, including: 

a. the enployTnent status of the client? 

b. the ba^is on which em^loyrnent was determined to be suitable? 

57. show that when the client accepts a job which fails to meet one or more 
of the suitability criteria (specified in 55 a-i, above), the counselor 
has : 

a. explained the unsuitable aspect(s) of the job 

b. indicated that the client has made the job choice in light 
of these facts? 

c. informed the client of the right to reapply for services if the 
^ob proves unsuitable or the need arises for further services? 

18. support the justification for closing t^je case When suitable criteria 
were not net, including the consideration of alteinaiives? 



GO ON TO SECTKW VIIT, PAGE 27. 




'Exhibit 9 (contj 





'SECTION Vltl: TIMELINESS RESEARCH AND COl^lENTS 
A; TIMELINESS 



INSTRUCTIONS: As indicators of timeliness in the various phases in the 
rehabilitation process, consider where applicable the information listed 
oelow pertaining to each of the status increments in coluams A, 6, and C* 
when responding to questions 1-4. 

A. Status 00-08/10 IMduc speed or time* lapses between referral/appli- 
Referral- cation of the client and the 'initial client/ inter- 
In/Eligibility view, the re<iuest for information^ the re«ipt of 

information on the client, addftixuial diagnostic 
"* services, extended evaliiation (if applicable), 

and any gap^ between or- during these^ events and 
^ the final eligibility decision and noti^cation. 

B. Status 10*1Z Undue speed or time lapses between eligibility de« 
(.Eligibility- termination and INRP approval, amount of frequency 
Plan Approval) of client contact during plan development. 

C. Status 12-26/28/30 Undue speed or time lapses betweeh IWRP approval 
(Plan Approval-. and initiation of services, duration of service 
Closure) receipt, contact with service provide^js, sched- 
ules for counseling, authorizations for payment/ 
purchase, client -counselor contact, job availa- 
bility, employer contacts, case record documenta- 
tion and regular interval^ and gaps in the process, 
especially between Status 22, placement, and 
closure (where applicable) . 



1. Was the client served in a timely manner? (i.e., without 
undue speed and without undesirable or unintended time 
lapses) 

2. If no, was the ca^t served ^ith: ^ 

a. undue speed? (Record reasons for 'this judgment in 
Section VIII 8.) 

b. undue time lapses? 

3. If a delay occurred, was the delay sufficiently ex- 
pljlined in the case record? 

4. If explained, was the delay caused by: (answer each) 

a. No response by client? 

f 

b. .Client indecision.? 

c. Client unavailability? 

d. No contact by counselor? 

e. No action by counselor? 

f. No counselor assigned? * 

g. Administrative delays? 

h. Lack of resources? 

i. ' Ddlay in receiving reports? 
j. Interagency delays? 

k. Lack of placement opportunities? 

1. Other? (specify) - 



ANSWER COLUMNS 


A(00-10/10) , 


8(10-12) 


CC12-26/28/30) 


Yes No N/A 


Yes No N/A 


Yes No N/A 
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Exhibit 9 (cont.) 

' 2S 



SECTION VIII: TIMELINESS i^SEARCH AND COMMENTS 
. B. REVIEWER COM^CNTS _ 



Please^ use the ;»patc below to provide any conments or feo.Unjjs you nay have about the case record. 
As an exanpie, /Our evaluation oc the Jocumentat ion may rerlect *com{:^iancc ^with. the federal Regulations 
and Cuidulmes, however, you may feei that the overall picture or that a specific area within the 
rehaoilitation process (i.e., the nature and/or scopv dCrvicCb, the counselor/ciicn^ relationshipr 
the counselor's creativity, the clarity or organisation of the case record, etc.) deserves comment. 
This space say also be used co docuraen^ specific problems encountered in the review. 
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EXHIBit 10 
Instructions for Modified 
Case Review (MCRS) 



\ 



s 



168 



EXHIBIT 10 » . 
MODIFIED CASE REVIEW SCHEDULE 
INSTRUCTIONS 



The Modified Case Review Schedule (MCRS) is an evaluation form which is 
based on the Fede'ral Regulations and Guidelines for the provision of Voca- 
tional Rehabilitation (VR) services through the State VR agency.^ This MCRS 
is composed of the following major sections and subsections which corres- 
pond with numbers and headings from the Case Revww Schedule (CRS) , developed 
by the San Diego State University RCEP IX. The MCRS includes only those CRS 
items needed to inform the Procedural Standards and the VR decision-support 
system. 



Section I : 



ERIC 



Section II: 

Section III: 
Section I^? 

Section V: 
Section VI: 
Section VII: 



Section VIII: 



Case Infbrmation 

A. Case Identification 

B. Significant Data and Supportive Evaluation 

C. R-300 Verification 

Evaluation of Rehabilitation Potential 

A. Preliminary Diagnostic Study 

B. Extended Evaluation 

Eligibility 

Evaluation of Rehabilitation Potential Tliorough 
Diagnostip Stydy — Statuses 02 and 10 

■ :> 

Individualized Writt-dij Rehabilitation Program 
Delivery of Services' \^ 

Hi 

Termination o£ Cases ' ; 

Case Closed Status^OS from 00/02 
Intervening Reasons 

Case Closed Status 08 from 00/02 — 
Ineligibility * 

Case Closed Status 08 from M — 
Iliieligibility 

Case Closed Status 30 and Status 28 
Not Rehabilitated . 



A. 



B. 




E. Case Closed Status 26 



Rehabilitated 



Timeliness Assessment and Comments 

A. Timeliness 

B. Reviewer Comments 
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^ Exhibit 10 (page ii) 

The intent of the original CRS A^as to determine if case service requirements 
and practice as specified in the Code of Federal Regulations (CRF) and the 
-Rehabilitation Services Manual (RSM) are documented in the case record* The 
modified CRS includes selected items f?:om the original CRS with the jintent * 
of responding to the concerns of four Procedural Standards. These standards 
include:' 

(9) Information collected on clients l>y the R-300 and all /data 
reporting systems used by RSA shall be valid, reliabl/ 
accurate, and complete^ 

(10) Eligibility decisions shall be based on accurate ^d suffi- 
cient diagnostic information, and VR shall continually review 
and evaluate eligibility decisions to ensure that decisions 
are being made in accordance with laws and regulations. 

(11) VR shall ensure that eligibility decisions and client move- 
ment through the VR process occur in a timely manner appro- 
priate to the needs and capabilities of the clients. * 

(12) VR shall provide ran Individualized Written Rehabilitation Pro- 
. gram for each applicable plient, and VR and the client shall be 

accountable to each other for complying with the agi;eement. 

Each CRS question is referenced to the.CFR and/or RSM. Further, certain 
CRS questions 'are referenced to the State Supplement Section of the CRS 
Manual where information on the state policy is provided. This refer- 
encing to state policy ocqurs wh^re the federal requirements show that 
the states have the option of fuMher defining the federal requirements 
which are provided within the CFR>md RS14. 

Instructions for completing the CRS wilTbe provided according- to the 
following: 

General Instructions , pages 1-4. 

Instructions Pertaining to Each Section , pages 5-42. 
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Exhibit 10 (page 1) . 

GENERAL I^ISTRUCTIONS^ 



1. Questions/Answer Scales; 



Please read the partial question or lead-in which appears in , 
italics at the beginning of each page, and at the beginning 
of a subsection within a page, as the -preface to each question. 

The items in Section I, II, III, IV, V, vi, vil, andVlII present 
three. .types of questions. One type o£ question seeks to validate 
information submitted on the R-»300 form with information re- 
corded in the client ^s case folder. Prior to the questions 
is a lead-in which asks:- Is the , following Information on thf 
R^300, or its equivalent, consistent with that found in the 
case record? 

This type of question is not asking whether documentation is 
in the case record, but whether documentation corroborates* 
the R-300 information. 

The reviewer responds by filling' in the appropriate answer 
circle: 



(7)= Verified; • . R-300 data incitid^d and con- 
sistent with that found in 
case record 

(2) =s Not Verified; R-300 data different fro^i 

that found in case record 

(3) = Case Record Only; Data recorded in case record 

only, not on R-300* 

0= R-300 Only; Data recorded on R-300. only, 

^ not in case record 

0= Not Recorded (N/R); , Data not recorded in either 
7^. case record or R-300 

' (6)= ^^ot Applicable (N/A); Data not applicable to client. 

The second tyjJe of question begins with a partial question' or 
lead-in sucfi^as: Does the case record* . Does the prelimi- 
nary diagnostic'' s€udy / . . / Does the imP. . . This type of ^ 
question is asking whether or not information or documentation 
is in the case record. The reviewer- responds by filling in 
the appropriate answer circle: ^' 



♦ ^ Not^ f 'X^'' shall ^eaj) ''MCRS** for these and all other insti^ctions . 



10 (page 2)- 



(T)= Yes ' The case record documents, 

* contains, shojvs, describes, 
in'crludes, indicates, provides 
^ the requested information. 

2) = Ho : * ' The case record does not 

document, contain, -^how, 
I * * describe, include, indicate, 

, - ' , • provide the required infor- 

mation* • ^ ^ . > ' ^ . 

* (3)= Not Applicable (N/A) . The question is not appli- 
' . cable to this ca^ ^record. 

The third type of question begins with a partial question or 
lead-in, such a^: How well does the counselor documentation 
in the^case record. . .or, To the degree necessary ^ how well ^ 
does the counselor documentation in the case record appraise. . 
This type of question requires that tfte reviewer make a judgment 
about the case, record documentation and respond by filling in 
the ^ppwpxlate answet circle: i 

Less than Adequate The case recorcl shows, 'de- ^[ ^ 

scribes, appraises, estab-* 
lishes, provides, documents, 
supports the requested infor- 
mation in a less than adequate 
manner, • In the .event that the 
requested information is not 
documented or riot recorded, ' 
the appropriate response is ^ 
less than adequate.- 

(2)= Adequate The counselor documentation 

shows, analyzes, appraises, 
establishes, supports the re- 
quested information in an 
adequate manner; or the data 
in the case .re'cord describes , " 
the requejBted infoi^ation. in 
an adequate manner. . 

0= Not Applicable (N/A) 'The question is not a^)plic3l2ie 

to this case record. » 

» ■v 

-* * • 

liTheri responding to this type of qu'estion,' the reviewer's task 
is to evaluate the adequacy 6t quality of the documentation. 

The' answer choices within 'the appropriate answer scale may 
dif fer from one <CftS question -to the next . The Not 'Applicable 
(N/A) answer choice is offere^':for those CRS question's which 
arc not required as case service/documentation practices in * 
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Exhibit 10 (page 3) ^ ' ^ ^ 

the Federal {Regulations and Guidelines, br where the federal 
requirement includcis a time limit, which may no,t be a^pplicable ■ 
to the case status ox progression at the time*"b£ the case 
review. ^ \ 

2. Directions: ' * \ \ * 

a. Please read the directions at the top'^^ the page and within 
.the page, when provided, to de^niline *tlie appropriate answer 
scale, , ' 

Please' answe*r all questions i^itless otherwise instructed. 
Specific Instructions are provided within the CRS at tjie begin* 
ning of particular sections, subsections and groups of questions 
indicating the appropriate, questions to respond to and/or to 
omit. That is, .if a section, subsection or group of questions 
does not apply, ^he section may be skipped- . The total CRS is 
not completed for any one case. , ■ 



Specific instructions for marking the answer Circles are located 
on page 1 of .the MORS. ... * 



' 3v Suggestions; 



Throughout the process of developing, .updating, and field testing 
the; CRS ^ a number* 'of suggestions have evolved •for applying the CRS 
to* cases* To assist the reviewer, the following suggesitions are 
provided: ■ / * ,^ ^ • » « 

a. ' Become familiar with the cise record prior to beginning the 

CllS by scanning the documentatidn and ;re^4ing "impoirtant sec- 
tions of the c^ase record, « 

b. Refer to the CRS Manual Instructions for clarification and 

* specific instructions throughout the course of tj^e -case Te- 
* ; view, N 



. In 'evaluating the lease record documentation, it is important 
.""^ ,to be aware of the differences in, case recording. Foir example, 

* > the clarity, styles organization^ and neatness of a ca^e re- 

cord may easily influenofe the evaluation.. Insofar as the 
Kjj-rity, style", organisaxlon and. neatness of the documerita* 
' tion can be separated from the presence and/or quality of the 

• documentation, these .diffei^ences should ndt be reflected in 
the results of the; evaluation^ . - * . 

• ' • ** " 

Definitions: . 1 ' . 

.a. Case Record^— the case folder or case file whiph cpnta?.ns 
^' the. case service records of the client. 'i 
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Exhibit iO ^(page 4) 

b. Couns^tlpr Dop^mentation -- this refers to the counselor's 
progress notfe^ on the client, synthesis of data obtained from 
other sources/^ and analysis or assessment ofVxase data in 
relation to .the client. ^ ^ 

c. Data — this refers' to the information obtained from other 
sources, such as objective reports from facilities' and schools, 

' V test results, reports from consultants. 

d. . R-300 this refers to the federal case service report, or 

the state's equivalent -form, required for each client apply- 
ing- for VR services. , 



o 
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Exhibit 10 (page 5) 

Section I: Case Information 

A. Case Identification 

B. Significant Data ^ 

The Case Inforrnation Section requires that specific information be ob- 
tained from the application, certification form, case service report 
CR-300 or its equivalent), individualized written rehabilitation program 
and amendments, closure statement, and other pertinent documents to be 
recorded in the squares provided. r ■ 

Completipn of the questions in Section I requires the identification 
and consistent use of the state's source documents. 

If federal or state reviewers or state VR agency staff complete this 
section, the source documents and procedures should be identified and 
explained in the State Supplement according to the state's policy. 



INSTRUCTIONS/GUIDELINES 



NOTE: IMPORTANT INSTRUCTIONS^ 



The instructions oji the CRS are provided to assist the 
reviewer in completing the review process. 
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Exhibit 10 (page 6) 
Section I 



Case Information 
R-300 Verification 



D;ites and information recorded in this section may be referred to by the 
^ reviewer while completing other sections of the CRS, 



INSTRUCTIONS/GUIDELINES 
(r.f.) 



The answer- to this question will govern the completion of Section 
I: C. R-300 Verfication as well as the pertinence of verifying 
the information provided in items dr. and cd. 



NOTE: IMPORTANT INSTRUCTIONS 



the instructions on the MCRS are provided as a key to marking 
appropriate responses as outlines for items dx. -^-SS^ 



/ 



(dr.) and (cd.) Record dates in the following manner: 

* ^^o^^h Day ^ Year 

This. will facilitate data analysis. . 

14-58 The items are includ'ed as a verification of the accuracy and 
validity of information found on the R-300 or its equivalent. 
The following matrix cYoss^ref^rences the CRS item numbers ^ 
with the federal R-300 it^m numbers. 

If Reference: PROCEDURAL ST^DARD #9. 
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(Revised) 




(Revised) 




(Revised) 


MGRS 


R-300 


MCRS ' 


R-300 


MCRS^ 


R-300 


Item . 


Item 


Item 


■ Item 


Item 


Item ■ 


Number ' 


Number 


Number 


Number 


Number 


.■ (Number 


dr. 


I.e. 


32- 


4.G. 


46 


4.E<4 


cd. 


4. A. ' 


A" 


4.H. 


, 47 


4. QUO 


14 


3. A". 








20. 


2. A. 


34 


4.1. 


48 


4.Q.11 


21 


2.B. 


, 35 


4. J. 


49 


4.Q.12 


22 


2.C. 


' 36 ( 


4.K. . 


50 


4.Q.13 


■ 23 • 


. 2.1.1 


'37 / 


4.K. . 


51 


4.Q.14 


24 


2.1.2 


38 1 


4.K.. 


52 


4.Q.1S 


25 


2.0. 


39 \ 


4.L. 


53 


4.Q.16 


26 


2. P. ' 


40 


4.L. 


54" ■ 


4.Q.17 


27 


~=2.R.a 


41 


. 4. P. 


55 


4.Q.d8 


28 


2.R.a 


42 


4. P. 


56 


' 4.Q.19.' 


29 


2.R.b 




4.E.1 


57 


4.Q.20 


30 


2.R.C 


44 


4.E.2 


58 


4.Q.21 


31- 


4.D. 


45. 


4.E.3 
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* i * » 

Section 11: Evaluation of Rehabilitation Potential 

A. Preliminary Diagnostic Study Status' 02 t 

Tlie Evalqation pf Rehabilitation Potential consists of a Preliminary 
Diagnostic Study, an^'^tended Evaluation (if necessary) , and a Thorough; 
Diagnostic Study. The {Preliminary Diagnostic Study' is conducted to - ^ 
determine eligibility. This subsection (11. A.) addresses only the re.-y 
quirements for the Preliminary Diagnostic Study. 

To evaluate the documentation for the Preliminary Diagnostic Study with- 
in the Evaluation of I^abilitation Potential Section, only the informa- ^ 
tion collected from referral through acceptance for vocational rehabilitation 
services or acceptance for extended evaluation should be consixlered . 
Referral and acceptance dates are recorded in Section I: Case, Information. 

\ 

INSTRUCTIONS'/GUIDELINES I 

4. ■ The medical information obtained should be sufficient to evaluate 
or appraise^^e current health status of the client, the specifics 
of the disabling condition, and to identify other impairments 

. ' which might affefct^^jrehaiJilitation potential. Existing medical 
information may be used if it is adequate. Reference: Code of 
Federal Regulations (CFR) 1361.34(b); RSM 1S0S.03A, ISIS'.OS, 
1515. 1*. ^ 

The above includes adequacy and recency. Adequ^y is established 
based on the comprehensiveness and recency of the ijiforraation. 
Recency has the outer time limit of, within one year. Cases with 
disabling conditions which' are more subject^ change should 
have more recent medical information. Reference: RSM 1515.13. 

The state policy, based on appropriate input from medical con- ft/ ^ 
sultants, should he used to judge the medical information in 
individual case records. Adequacy of the state policy should 
,-be commented on* as part of an overall summary of the total case 
xeview. 



State policy: see State Siip^alement Section of the Manual. 

'S. A psychiatric or psychologjCcJlT exaipination is requii^ed as part 

of. the preliminary diagn'bsticSjt^dy in all cases where there is 
an emotional or mentar disordef . . The RSM specifies that this 
examination must be a "thorough evaluation, macf^ by a physician 
skilled in the diagnosis and treatjmeift: of such disorders, or by 
a psychologist licensed of'^'certified^in accordance with state 
^ laws and regulations." Reference: CFR 1361 .34 (b) ;* RSM 1505. 03A, 
1515.18. i 

6. Necessary examinations include a general medical examination 

or equivalent (such as a report from a recent hbspital , clinic 
examination) and those additional diagnostic studies which are 
required to ;/nake a determination* of eligibility, or the 
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Exhibit 10 (page 8) 



detennination that extended evaluation is required. Diagnostic 
studies could include medical , psychological, vocational studies, 



etc. 



State Dolicy regarding necessary examinations should be used to 
further evaluate th^ .individual case records. Reference: CFR 
1361.34(b) ; RSM 1515.08."" 

.State policy: see State Supplement. • 

7. Since the purpose of the provision of vocational rehabilitation 
services is to .enable disabled clients to prepare for and' engage 

• in gainful employment, a, preliminary diagnostid stifdy must docu- 
ment (a) the presence of the medically reCognizted physical or 
mental disability; (b) how the identified disability is substan- 
tially handicapping to that client; and (c) the client's poten- 
tial to enter gainful employment as a result of vocationa.1 
rehabilitation services. All points, ^(a) , (b) and (c) , must 
be* documented or the preliminary diagnostic study would not 
place primary emphasis unon the client's potential for achieving 
a vocational goal. References: CFR 1361.34(b); RSM 1505. 03B. 

8. Reference: CFR 1361.34(a)(1). 1361 .1 (S) 1361 .38Ca) ; RSM 1505. 03A. 

9. • J^eference: CFR 1361 .'34 (a) (1) , 1361. l(bb), 1361. 38 (a>; RSM 

1505. 03B. . • . 

,10. ■ Reference: CFR 1361 .34(a) (2) . 1561.38(a) ; RSNl 1505. d3C. 
11. .Reference: CFR 13^. 34(a) (2) , 1361.38(a) . 



NOTE: IMPORTANT INSTRUCTIONS 

pre. instructions on the CftS are provided to assist th^^ 
reviewer in proceeding to the appropriate CRS subjection 

s • - — ^ — - 



or section. 



12. A client can be identified as severely disabled at any time 
during the rehabilitation process if the client meets the 
definition of severely disabled. I^the client .is not identified 
as severely disabled at th^ point in the process, the response 
to this question (II .A. 12) *?hould be N/A. 
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Section II: Evaluation of Rehabilitation Potential 
B. Extended Evaluation — Status 06 

The Evaluation of Rehabilitation Potential consists of a Preliminary 
Diagnostic Study, an Extended Evaluation (if necessary), and a Thorough 
Diagnostic Study, This subsection (II .B,) addresses only the require- 
ments for the Extended Evaluation to determine rehabilitation potential 
including the requirements pertaining to certification, the individual- 
ised written rehabilitation program (IWRP), and the delivery of ser- 
vices under extended evaluation. The requirements for terminating the 
case from extended evaluation are contained in CRS Section VI: Ter- 
mination of Cases • 

To evaluate the documentation for Extended Evaluation, only the infor- 
mation collected from the referral date through the termination of 
extended evaluation date should be considered . The termination date 
should coincide with the date indicated on the certification of eligi- 
bility or ineligibility, whichever is appropriate to the termination 
action taken. Referral and termination/acceptance dates are recorded 
^^^^JLn CRS Section I: Case Information, 

/iNSTRUCTIONS/GyiDELINES 

Certification for Extended Evaluation 

Accordin^^to the Federal Guidelines, ''certification i^ the assurance 
' by the srate agency .that in each case the basic conditions prescribed 
in the Regulations and set forth dn tfie state plan have been met, . . 
information to substantiate the certification must be included in each 
case'record,-'' Reference RSM 1505, 05A, 

14, Reference: trPR 1361, 37(b); RSM 1505, 05A, 

a. Reference: ^FR 1361, 37(b); RSM 1505. 05A. 



•3) 



Individualized Written Rehabilitation Program (IVIR?) for Extended 
Evaluation 

Tl)e purpose of the .IWRP requirement in the Rehabilita|p»on Act is "to 
continue, extend, and formalize the case planning and management prac- 
tice of setting forth goals and objectives, and means and time frames 
for achieving them, as well as to assure client pa^rticipation and pro- 
tection of client rigfits. , Reference; RSM 1507,02. 
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The procedures which are set forth in the Code of Federal Regulations 
and the Rehabilitation Services Manual for the IWRP apply to the program 
for each handicapped client eligible for VR services and to each handi- 
capped cMent eligible for such services under an extended evaluation 
to determine rehabilitation potential. ,^ 

18. The reviewer should respond YES to this question if the case - 
record contains an IWRP form (including pre-printed information) 
or a 'combination of forms which are identified as the IWRP. For 
identification of the IWRP^ form(s) , refer to the state policy. 
Reference: CFR 1361.38(e); RSM 150f.02, 1507.05. 

State policy: see State Supplement. . 



NOTE: IMPORTANT INSTRUCTIONS ' 

The instructions on the CRS are provided to assist the re 
viewer in proceeding^ to the appropriate questions in CRS 
Section II.B. 



19-21. CRS II.B., Questions 11-13, pertain to information' which the 
CFR and RSM suggest may be contained or covered in the pre- 
printed information that the state has included in its IWRP 
form. Those questions which are identified^ covered in the 
state form pre -printed information should onl\be responded 
to once at the beginning of the review of the total sample of 
cases. Those questions which are identified as not covered 
in the state form pre*printe*d information should be responded 
to for each case in the review sample. 

The inclusion or .exclusijon of the suggested pre-printed, infor- 
mation in the IWRP (state form) does not reflect the presence 
or quality of the counselor's documentation; rather, the review 
of the information contained in qu^stiwis 11-13 provides a re- 
view of the state's policy as reflected in the IWRP (state 
form) . ■ Reviewers may comment on the completeness or adequacy 
of the IWRP (state form) in Section VII:- -Reviewer Comment^. 

19. The general basis for a determination that an extended evalua- 
tion .is -necessary to make a determination -of eligibility is 
presented in the IWRP to provide the client Uith basic infdr- . 
mation needed by the client to exercise client ri-ghts* Accord- 
ing to the RSM, the general basis for such determination could 
be presented in a 'standard pre-printed -statement in th,Q IWRP. 
The completed record of such determination is contained else- 
where in the case record since it is often long, technical, and 
involved diagnostic and evaluative data. Reference:, CFR 
1561.59(c)(l)rRSM 1507. 07A. . 
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20! The terms and conditions may be ij|pluded as standard content in 

a pijb-printed statement in the iwf? along with any content specific 
to the individual client. Reference: RSM 1507. 07B.. 

' . : , ^ ■ ■ 

a. Reference: CHR 1361 .SS-Cf ) (7) ; RSM 1507 ..07B.' 

b. Reference: ' CFR 1361.39(c)(7); RSM 1507. 07B, 1513.05. 
cJ Reference: CRF 1361.39(c)(7). % 

d. Reference: RSM 1507. 07B 

e. Reference: RSM 1507. 07B 

f. Reference: RSM 1507. 07B 

g. Reference: RSM 1507. 07B 

* • 

21. Client rights may be set forth in standard prepared statements, 
but the case record should reflect that t£he client understands 
these rights. Reference: CF,R 1361.39(c)(8); RSM 1507. 07B. 

a. Reference: RSM 1507. 07B. ^ . ^ 

s , b. Reference: CFR 136f.39(c) (8) ; RSM 1507. 07B. * « 

c. Reference: CFR 1361.39(d); RSM 1507.08. 

d. Reference: • CFR 1361.39(e)(3); RSM. 1507. IOC. 

22. This question is grouped with the questions pertaining to the 
state form, since the separateness of the IWRP in the case record 
IS a reflection of the IWRP design or .state policy. Reference: 

V* CFR 1361.38(e); RSM 1507.05. 

23* The RSM specifies that written copies of amendments need to' be 
provided to tfiie client only in the case of substantial amend - 
' ments. One example of a substantial amendment is the scheduling 
of a new service aijd the dropping of a previously planned ser- 
vice. For identification of the client's copy of the IWRP, 
* ^ refer to state policy. Reference: CFR 1361.39(a); RSM 1507.05, 
^ 1507.06, 1507^.11. 

State policy: see State Supplement section of the Manual. 

24. Acc0^-ding to the RSM, program is required concurrent with, 

or reasonably soon, after .. .the certificate of acceptability for 
extended evaluation." Reference: CFR 1361.39(a), 1361.39(b); 
RSM 1507.04. ^ • 

26. Relference: CFR 1361.39(a); RSM 1507.02, 1507.06, 1507. 07B, 
1507. lOB. 
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28. 'Intermediate rehabilitation objectives^ are steps or levels of 
achievement for the clienr.and are "not 'senrices,. _Sei:yices are 
the means by which the client maf achieve the intermediate 
rehabilitation objective. For exampLe., the correction of a 
medical problem <i.e., to be physically restored) may require 
a physical restoration service such as surgery. Reference: 

. CFR 1561. i9 (c)(2); RSM 1507.070. 

29. Vocational rehabilitation services are furnished to enable the 
client to achieve the intermediate rehabilitation objectives. 
The IWRP states specific services to ^e provided or,' at times, 
it may "categorically*' describe a service which is planned. 
Reference: CFR 1361.39(c)(5); I\SM 1507. 07D. . 

30. Reference: CFR 1361.39(c)(4); RSM 1507. 07D. ' ' 
Si. ^ Reference: CFR 1361.39(c) (4) ; RSM 1507. 07D. 

32. Reference': CFR 1361 .39(c) (4,) ; RSM 1507. 07D. 

33. Reference: CFR 136i. 36(d). 

34. Objective criteria for evaluating the client's progress toward 
the intermediate rehabilitation objectives must be stated in 
terms which are me^iningful to the client. Reference: CFR 
1361.39(c)(5); RSSf 1507.07F. \ ' 

•i • » 

35. This CRS item refers to the procedure or methods which the coun- 
selor uses to evaluate the client's progress toward the inter- 
mediate rehabilitation objectives. As stated in the RSM, methods 
may include the case review, discussion \/ith the client, and * 

* objective reports of progress. Part of the procedure may be 
established in standard prepared statements in the IWRP, along 
with statements of a particular. application to the client. 
Reference: CFR 1361.39(c)(5); RSM 1507. 07F. 

36. The schedule for periodic review and evaluation should consider 
the nature of the client's situation as well as overall agency 
procedure. The schedule may be partially established in standard 
prepared statements. Reference: CFR 1561.39(c)(5); RSM 1507. Q7F. 

11^ * A summary of the results of periodic reviews and progress' evalua- 
tions is entered in the IWRP as a record of such reviews aita 
evaluations. Reference: CFR 1361 .39(c) (5) ; RSM 1507. 07F. 

38. The IWRP for extended evaluation must be formally reviewed at 
least annually with the client's involvement in the redevelop- 
ment of the program, as appropriate. As suggested in the RSM,^ 
one of the scheduled progress evaluations may be expanded to 
provide a formal, annual review. » Reference: CFR 1361.39(c) (H) ; 
RSM ^507.08. 

194 . 
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39. Reference; CFR 1361.3^c)(6) ; RSM 1507. 07E. 



NOTE: DJPORTANT INSTRUCTIONS 

^icse instructions on the CRS are provided to^ssist the re- 
v^iewer in proceeding to the appropriate CRS question (s) at 
the conclusion of Section II.B. 



40. Reference: CFR 1361.37(a); RSM 1505. 05A. 
42. Reference: CFR 1361.39(e); RSM 1507.10. 

a. ^/«:eference: CFR 1361.39(e)(1); RSM 1507. lOA. 

b. The rationale for the decision and other pertinent facts 
will.be recorded as an amendment to the program. The 
amendment will include the basis for the ineligibility 
determination and will indicate the client's involvement 
in the decision. Reference: CFR 1361.39(e)(2); RSM 
1507. lOB. 

4 

^ c. Reference: OvR 1361.39(e)(2); RSM 1507. 10ff. 

d. A review of the case with respect to the ineligibility 

decision is based on the possibility of changed conditions 
and new information about the client's rehabilitation 
potential. Situations ifi which a periodic revtew would 
be precluded are those. in which a client has refused ser- 
vices or a periodic review, the client is no longer present 
in the state, the client's whereabouts are ur^cnoi^, or the 
client's medical condition is rapidly progressive or ter- 
minal.- Reference: CFR *1361.39(e) (3) ; RSM 1507. IOC. 

A 

Delivery .of Services 

The Delivery of' Services questions require responses to all of the 
VR services available under extended evaluation in therms of whether 
or- not the services were planned for the. client . Further, an evalua- 
tipn of whether each of the VR services is given to the client is 
required. 

INSTRUCTIJf(S/GUIDELINES * * , 

The Delivery of Services questions for the Extended Evaluation sub- 
section use a different c^uestion and answer format." Question B pennits 
only a YES or NO response, while Questions Cand E permit a YES, NO, or 
N/A response. * \ 
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The reviewer is requested to make judgments 'about each Ifttvice. The 
reviewer should respond to Questions B, t\ and E for eaph'service (items 
43-54) that was" given under extfended evalimtion. 

Question B: The reviewer is instructed to respond YES pr MO for 
eaph' service; to show whether or not tHat service was 
j| planned. Reference CFR 1361.38(aJ. 

' Question C: The reviewer is instructejl to respond YES or NO to 

show whether or no^ the service was given; or N/A to 
indicate that the question of tire Iseiiyice being given 
is not applicable , to the status of the case at the 
time of the review. As an example, for a case which 
has physical restoration services planned, but has 
not progressed to the point of the service being given, 
the appropriate response is N/A. Reference: CFR 
1361.38(a). 

Question E: The reviewer is asked to make a judgment as to whethlr^ 
^ ' .or not (full consideration" was given to similar 

benefits that ate available to lielp ineet the cost of 
the service. n. 



Serv'ides , 

43. DiagTlostic and related s^lrvices are those services incidental * 
to the determination of eligibility for VR services and the 
nature and scope pf VR services to be provide'd. ** Reference: 
CFR 1361.40(a)(1). 

44. Counseling and guidance services include persoi^al adjustment 
counseling to maintain a counseling relationship throughout 

the client 's program of service; and' referral to help the client 
obtain needed services firom ot^er agencies when such ^services 
are not available under the Rehabilitation Act. Reference: 
CFR 1361.40(a)(2). 

45-46. Physical and mental restoration services are defined as "those 
services which are necessary to correct or' substantially modify, 
within a reasonable period of time, a physical or mental condi- 
tion which' is stable or slowly progressive^ However, when' 
physical and ro^tal restoration services are provided under an 
extended evaluation of rehabilitation poxential, the ^provision 
that the condition is stable or slowly ^ogressive does not 
apply. \ ^ 

These servifces include: ' • 

< a. medical o^r corrective surgery treatment;- 

b. diagnosis and trea^iment for mental or emotional disorders; 
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c, dentistry;', 
nl. nursing servic'e^; 

e. necessary hospitalization and clinic services; 

f. ^convalescentitor nursing 4iome care; ♦ 
/drugs and supplies; ' ^ 



0 
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h. ^ prosthetic, orthotic, or other assistive devices essential 
, * to obtaining, ^retaining employment; 

i. eyeglasses and visual services; 

j . podiatry; * • ^ , ) ' 

k. physical therapy; ^ 

1. occupational therapy; * ^ 

m. speech or hearing therapy; ' 

* n. psycholofical services; > ^ 

0. medical or medically-related social work services; 

^ ,p. 'treatment of acute or chronic medical comp'lications ; 

q. special services for ti;eatment of individuals suffering 
from end-stage renal disease; and^ 

r. other -medical or mAdically-rela^ed rehabilitation services. 

Reference: CFR 1361 . 1 Cr) (1-18) ; RSMrl513., 1513.05(3); 1513.11, 
1513.13. . . ^ . ^ 

47/ Vocational and other training services include personal vocational 
adjustment, books, tools 'and other training materials; Refer- 
ence: ^CFR 1361.1(ee)(iv), 1361.40(a)(4). 

48. Maintenance is defined as: **Payments, not exceeding the esti- 
mated cost of subsistence," which are "provided at any tim^ 
^rom the date of initiation of vocational reHabiliration ser- 
vices through the provision of post-employment services." 
Maintenance is provided to cover a..client*s basic living expenses, 

*S ,such as food, shelter, clothing and o'tjier subsistence expenses. 

Maintenance is provided only in order to enable a handicapp^ed * 
client to de'tive the , full- benefit or other VR services being 
provided uiider an IWRP. • Maint:enance may be paid during any 
stage of, the rehabilitation process. Reference: CFR 1361. l(m), 

• 1361.40(a)(5); RSM 1527.02. 
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State policy:* see State Supplement. Reference: RSM 1527.02, ^. 
1527.03. 

<i ^ - V 

49. Transportation is defined as "necessary travel^and related ex- 
pense5 including subsistence during travel for clients and their 

'/ * , attendants for the purpose of providi;ig vocational rehabtilita- 

, tion services." This* may include relocation and moving expenses 
^ which are necessary for the achievement of a vocational rehabili- 

* tation objective. . » • / 

^ ^ ' ^ Transportation services may include: ' ^ 

; ' \ > . ^ 

a. fares ir travel costs associated withuising public or pri- 
^ • vate conveyances;' ^ ^ * * 

* ' ' • ^ * • . 

* b. subsistence or per diem* in lieu of subsistence while in 

travel status; 

I . c. attendants dr escorts for the severely handicapped and the 

attendants* travel co*sts; 

d. / relocation ^and moving e.^enses; and 

e. other related expenses to tr'aijsportation. 

\, Reference: CFR .1361. l(cc) , 1361.40(a)(6); RSM 1529.05, 1529.06. 

•••»-* 

50. Services to family members are provided iwhen "necessary to the 
Adjustment cJT rehabilitation" of the client. These services 

' ' may^clude any of the VR services avadlable to clients under 

CFR 1361.Uee)(lJ. Reference: CFR 1361.40(a)(7), 1361 :i (ee) (1) , 
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51. Specialized seryices for blind, deaf and other severe disabili- 
ties include: 

a. reader services, rehabilitation teaching services, , and 
^orientation and mobility services for the blind; ^ 

b. interpreter services for the deaf. ^ ^ ' ^ 

Reference: CFR 1361.40(a) (8,9) . ^ ' 

' . * • 

52. Telecommunications, sensory and other technological aids and 
devices are technological advancess and the resulting devices 

* and related services which are apT>lied' to client needi to ' 
f:jcilitate their achievement of vocational rehabilitation goals. 
Re'^ference: CFR 1361'.40(a) (10) ; RSM 1555.05. ' 

53. f Occupational • licenses, tools, equipment, initial stocks and 

supplies may be provided under certain conditions, to help deter- 
• mine eligibility for rehabilitation services such as in extended . 
\ \ ' ' - • 
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evaluation. According' to RSM 1,545.04, ''care should be exercised, 
however, when providing these services during 'an extended evalua- 
tion period, as in most cases they are considered employment-^ 
oriented services .. :to increase the individual's opportunities 
for successful employment. . State agencies may wish to 
develop guidelines explaining the special conditions under which 
occupational licenses, |ools, etc., may be provided under an 
ec<tended evaluation period. Reference: CFR 1361 .40(a) (14) 
RSM 1545.04. 

State policy: see State Supplement. * 

54. Other goods and services are those services which can reason- 
- • ably be expected. to benefit a client in- terras of the-client's 
evaluation of rehabilitation potential. Reference: CFR 1361.40 
*(a)(15). 



c. ^ 




187 

Ejdiibit I'O (page 18) . 
Section III: ^ Eligibility Status 10 

The Eligibility SecjCioh requires certification that the client has met 
the basic conditions for eligibility for VR services V - 

(1) . thf^. presence of a* physical or mental disability; 

(2) ,the condition that\h^ physical or mental disability consti- 
1^ tutes or results,<OT a substantial R'aildicap to' employrfient fqr , 

thfe clientT^and , ^ ' 

(3) a reasonable expectation that vocational rehabilitation ser- 
* vices may benefit the client iri terms of employability. 

Reference: * CFR 1361.33(b) (1-2}. . . i 

"According to RSM' 1505.03B, a vocational handicap means *'a limitation 
imposed by a, disability that renders vocational success more diffi- 
cult," and the ''principal consideratioit for the yocationa^ rehabilita- 

. tion program is the direct relationship between disability and 
emplbyability, i.e., the effect a disability has on an individual's 
employability." ^ 

These references are provided to emphasize the relationship between 
the disability and the clieVt's employability vltiich must be documented 
as parf of the eligibility determination, Th'e Eligibility Section re- 
quires the counselor's analysis and supporting' documentation as to why 
the client is determined eligible for vocational rehabilitation services. 

To evaluate the documentation for the Eligibility Section, only the 
Information collected from tjie referral date through the date certified 
as accepted for vocational rehabilitation services should be considey^ > 
Referral and acceptance dates are recorded in CRS Section I: Case 
Information. 

INSTRUCTIONS/GUIDELINES 

1. According to the RSM, "certification is the'^assurance by the 

state agency that in* each case the basic conditions prescribed 
in the Regulatitjns and set forth' in the State Plan have been 
met." Reference:" CFR 1361 .33 (b) (1-2) , 1361. 37(2^); RSM 1505. 05A, 
1505. 08A. 

a. Reference: CFR 1361.37(a); RSM 1505. OSA. . . , " 

N'OTEV Items 3 through ,8 require an evaluation of the quality oif the 
documentation. The reviewer is requested to evaluate how well the basic 
conditions of. eligibility for VR service? are^ established^ shown, ^and 
assessed in the case record.* 
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Physical oi^ Mental Disability ' . i . , 

3. An ev^iluation less tlTan adequate should be made if the re- 

quired d^ta is not in the/case record or if the data (medical 
report, psychological reyort) is minimal (e.g., only an- IQ 



score) 



An evaluation of adequate should be made if all the required 
data supporting the existence of a disability is in^the case ^ 
record, including the general medical information and 'any other 
^ , required "data/documentation on specialty examinat,ioi>s ' (IQ score, 

description of adaptive behavior, assessment of reading level, 
etc). * Further, this data should be appraised by the VR coun- 
selor in relationship to the client's disability. Reference: 
CFR 1361.33(b); RSM lS0S.06A(a). 

4. .An eva'^bation of less than adequate should be made if the case 

record provides only a desci;j.pti6n or ^listing of the limita- 
tions to the client's. activities or functioning. 

An evaluation of adequate should be made if the counselor's . 

analysis of how the disability affects the client's function- 

' , * ing is made. Reference: CFR 1361. l(s); RSM 1505. 03A. 

♦ • 

Substantial Handicap ^ 

In relation to the tVR program, substantial means that the disability 
' or its*' limitations impose a considerable or ^significant handicap to 

the client's occupational performance, y"^ 
r ^ ^ ^ . • 

5a 5d. The RSM Oiapter 1505.06 specifies that the case record must 
include, as a minimum, the "agency's analysis showing the 
specific ways in which the medical, psychological, vocational, 
^ and other related factors impede theJ.ndividual '^ occupational 

performance. . ." * . -t^^S . 

^ Since not all of the factors specified in 5a-5d are operative 

or would impede all clients, the reviewer must deterrainp the 
^appropriateness of each category of factors in evaluating the 
adequacy of the counselor's analysis. 

^ * An adequatd analysis must be based on the presence of descrip- 
tive data and the relation of this to the client. As an 
example,- in order to evaluate that the documentation provides 
an adequate analysis of the medical factors (question 4a, re- 
ferred to above), the case record must first contain descrip- 
tive data, such as medical repo^ and specialist reports (if 
applicable) as a basis for the analysis. • Secondly, the medical 
factors must be related to the client in terms of their impact 
' on the client's occupational performance. - / 
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The factors specified in 5a-Sd pertain to the following: 

a. medical physicaj disability; ^ 

b. psychological — mental and emotional disabilities; • 

c. vocational — vocational adjustment including patterns of 
work behavior (e.g., worker traits, length of time on pre- 
vious jobs, supervisory and co-worker relationships, atten* 
dance and punctuality, .transferability of skills, productivity 
and/or quality of work); and 

d. educational educational background in relation to voca- 
tional c^jective^ including preparation (e.g., training). 

If the case record only contains descriptive data pertaining 
to the factors citedSi above, the appropriate response is ' less 
than adequate . If the descriptive data, examinations rei'^orts, 
test results, and observations are analyzed in terras of their 
impact on the client's occupational perfonnance, the appropriate 
response is ' adequate . Reference: RSM 1S0S.06. 

6. In assessing the vocational handicap, or the limitations imposed 

by the disability which impede the client's occupational perfor- 
mance, other related factors which bear upon successful vocational 
participation should be'cQnsidered. Any related factors 'which 
are appropriate to the client should be considered. These 
factors may include, but are not limited to^,^.the following: 

a. lack of marketable skills;- 

b. low educational iQvel^; 

community and employer ^ejudices and attitudes concerning / 
disability; 



c 



d, long-term unemployment; ^ 

^e.' unstable work record; and 

f. poor attitudes toward work, family and community. 

Reference: RSM 1S0S.03B.. 

7. This question refers to the situation in which a disabled client 

• • is emjJloyed substantially belo\^ potential and is provided VR 
services to help the client engage in\an occupation more con- 
sisteitt with the client's capacities and abilities. This guide- 
line, as explained iti RSM 1505*03, addresses the problems o£ 
underemplqyment, marginal and insecure employment of the handi- 
capped. To show that this situation meets VR eligibility 
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requirements, the case record should also document that the 
client has medically recognizable physical or mental disability(ies) 
which impose (s) a substantial handicap to employment. Reference: 
RSM rS05,05B, . ^ . 



Reasonable Expectation 



I 



8. ■ To determine that there is a '^J^ikelihood/' the state agency 
must "evaluate and ascertain potential capacity of the indi- 
vidual for employment, taking into consideration the effect the 
agency's services may have on reducing or cc^recting*,the dis-. 
ability'' or on lessening the employment handicap. Reference: 
- RSM 1505. 03C. ' : 
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Section IV: Evaluation of Rehabilitation Potential Through Diagnostic 
Study — Statuses 02 aiid 10 - ' ^ * • 



The "nature" of vocaj^ional rehabilitation servides refers to 
what specific services are needed by the client .to attain the^ 
client's vocational goals. Reference: CFR 'l361.3S(a) . 



The "scope" of, vocational rehabilitation services refers to 
how much or the extent bf these services that are needed by the 
client to attain the client's vocational goals,, Refeifence: ' r 
CFR 1361.35(a-b). ' ' • 

To respond to this item the reviewer is requested to determine^- 
if the thorough diagnostic s|udy consist.^- of a comprehensive 
evaluation.;' In order to l^espond YES to this item, the reviewer 
must determine if pertinent medical , -psychological vocational, 
educational, and other related factors have been included and, 
considered in the evaluation to the degree necessary for the 
particular ca^. ' Reference: ..CFR 1361. 3SCa). 
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Individuarized WritterTRehabilitation Prograjn (IWRP) 
Status 12 and, ^9ve 



Section V; 

^' ' Status 12 and, ^9ve , ^ 

The purpose of the livRP requirement in the Rehabilitation Act is "to 
continue, extend, and- formalize the case planning and^manageirient p^acAice 
of se£t5.ng forth goals and objectives, and means. and timeNframes for ^ 
achieving them, as well, as'to assure client ^artioiplation and protection 
^ 'of client rights. . Reference; RSM 1507.02. .'' " . 

• . . . ^ ' ' '> 

To\evaluate the documentation foVthe HVRP*, only the information gol- 
wlected from re ferral> through the development and implemen tation of the " 
program and amendments should be- considered . :ReferTal and^ IWRP dates ^ 
. are recorded m CRS Section I: C^e Information. 
* * - # ' 

INSTRUCTIONS/GUIDEi:INE^ \ ^ 

1 ' * T^e reviewer should ,i^pond YES, to this question if the^case * . 
\. ' fScorS contains an,.tWR:P 'form' (including pre-printed information) 
or a combiriatioft of forms which are identified as. the IWRP; 
For identification of the IWRP forra(s), ref^ry^to the state 
• policy. Reference: CFR 1^61. 38 (e) ; RSM 4507.02, 1507.05. 

State policy: see State Supplement. ' 



NOTE: JMPORTAiNT INSTRUCTIONS 

^The instructions on thd CRS are provided to assist the re- 
viewer in proceeding to the appropriate quest^^ in CRS 
Section IV or .to the appropriate CRS Section. . 



i 



2-S. CRS IV, questions 2-5, pertain to information which the CFR and 
RSM suggest may be contained or covered in the pre-printed infor- 
mation that the state has included in its IWRP form. Those, 
questions which are identified as covered in the state fbrm pre- 
printed information should only be responded to once at th6 
beginning of the review of the total sample of cases; Tho^e 
questions which are identified as not covered in the state form 
pi»e-printed information should be responded to for each case m 
the review sample. ^ , ' - 

The inclusion or exclusion of ^ the suggested pre-printed informa- 
tion in the IWRP (state form) does not reflect the presence or^ 
quality of the counselo^^'s documentation; rather, the review of 
the information contained in questions 2-S provides a' rq^view of 
the state^'s policy as reflected' in the IWRP (state form). Re- 
viewers may comment o/i ^he completeness or adequacy of the IWRP 
(state form) in Section VII: Reviewer Comments.' ^ • 
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2. 



4* 



r 



6: 



The general Basis of .eligibility is presented in the I}VRP to 
provide the client with^bgsic information about the client's 
eligibility^ status. According to the RSM, the general basis 
of eligibility Qould be prejented^n a standard pre-printW 
statement in the IV/RP. The completed recoi^ of eligibilipy* is 
contained elsewhere -in the case record since it 'is often long, 
technical, and iipvolves diagnostic and evaluative data. Refer- 
ence: CfR 136lSv59(c);(l); RSM .1507. 07A. , ^ 

Th^ t^lns- and conditionsi may be included as standard content 
in a pre-printed statement in the IWRP along with any content 
spe5:ific to- the individual cli,ent. Reference: 6SM 1507. 07B. 

• a. Reference: CF^ 1361.39)[c) (7) ; RSM 15Q7.07B. 

/ b. Reference: CFR 1361 .39Cc) (7) ; RSM 1507. 07B, 1513.05. 

c. Reference: CFR 1361 .39Cc) (7) . 

d. Reference: RSM 1507. 07B.- ^ . 

e. Reference: RSM 1507. 07B. 

f 

f. Reference:' RSM 1507.078. ^ 

' Client rights may be set forth in standard prepared statements, 
but the case .record Should reflect that the client understands 
these rights. Referfnte:/ CFR 1361.39(c) (8) ; RSM 1507. 07B. 



a. Reference: * RSM 1507. 07B. • « • 

b. Reference: CFR 1361. 39(c) (8) ; RSM 1507. 07B. 

c. Refereijce: CFR 1361.39(d); RSM 1507.08. ^ • 

d. Reference : CFR 136'1.39(e) (3) ; RSM l5a7'.10C. 

This ^question is grouped with the questions pertaining to the 
state form since the separateness of the IWRP in the case record 
is a reflection 'pf the IWRP design or state policy. Reference: 
CFR 1361.38(03; RSM 1507.05. 

\ —7 . ' ^ 

The RSM specifies that written copies of aii^endments need to be 
provided to the clientj^nly in the. case of ^substantial amend- • 
ments . One example of a subaliantial amendment is the sctieduling 
of a new service and the dropping of a previously planned ser- 
vice. For identification pf the client's copy of the IWRP, 
refer to state policy. Reference: gFR 1561.39(a); RSM 15<37.05, 
1507.06, 1507.11. 

State policy: see State Supplement. 
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« 

7. ^Accord^ng to the RSM,-"A program is required concurrent wi\h, or 
reasonably soon aftfer execution of the certificate of eligibility 
for VR services..." Reference: CFR 1361.39(a), 1361.39(b); RSM 
1507.04. ■ ' 

9. Ref,erence: CFR 1361.39(a); RSM 1507.02, 1507.86, 1507.078) 1507. 

lOB. ' 

11/ According to the RSM, 'The basic program' and all changes shall 

relate case data to an employment goal." Reference CFR 1361.39(c); 
-^SM 1507 . 07C. - ^ ' ^ • 

12. The long-range employment goal has been described as a vocational 
outcome which is consisteijj; with the client.* s capabilities and 
toward which the client and ^counselor are jointly working. 
Reference: CFR 1361 , 39(c) (2) ; RSM 1507. 07C. 

13. Intermediate rehabilitation objectives are related to the attain- 
ment of the long-range* employment goal in that^^ they are steps 
which must be achieved before the long-.range employment goal 

can be attained.' These steps or levels of achievement for the 
client are not services; rather, services are* the means by which 
the client may achieve the intermediate objective. For example, 
the coTTection of a medical problem (i.e., to be physically re- 
stored) may require a physical^ restoration s^iervice such as sur- 
gery. Reference: CFR 1361 , 39(c) (2) ; RSM 1507. 07C, ^ 
* « K ^ [ 

14. Vocational rehabilitation services are furnished to enable the 
' client t^ achieve the intermediate rehabilitation objectives 

and the employment goal. The fWkP states specific services to 
be provided or, at times, it may ''categorically" describe*a 
service which is planned. As ^n' example,, the RSM cites training 
in a clerical field as a categorical description of a planned 
service rather than nam-in'g the specific ^CSourse of study. Refer- 
ence: CFR 1361, 39(c) (3); RSM 1507. 07D. 

15. Reference: CFR 1361.39(c)(4); RSM 1507. 07D. 

16. . Reference:. CF^ 1361.39(c)(4); RSM 1507. 07D. 

17. Reference: CFR 1361 , 39(c) (4) ; RSM 1507. 07D. 

18. Objective criteria for evaluating the client's progress toward 
an employability goal mast be related to the intermediate objec- 

'tives-of the IWRP and'must be stated in terms which are meaning-- 
ful to the* client. As an example, if an- intermediate objective 
is the achievement of a skill such as typing, the criteria might 
be attendance, obtaining a specified ^rade average, and achieve- 
ment of a certain typing speed. Reference: CFR 1361.39(c).(5) ; 
RSM 1507. 07F. 
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19. This question refers to the procedure or methods which the coun- 
selor uses to. evaluate the client's progress tfoward goals and 
objectives. As stated in the RSM, methods may include^ the case 
review, distussion- with the client, and objective reports of 
progress. Parts of the procedure may be established in standard 

* prepared statements in the IWRP along with statements of parti- 

.culaf application to the individual cliqnt. Reference: CFR 
1361.59(c)(5); RSM 1507. 07F, 

20. . The schedule for periodic review and evaluation should consider 

the nature of the individual client's situation as ^well as over- 
all agency. procedure. The schedule may be partially established 
in standard prepared statements. Reference: CFR 1361. 59 (c) (5) ; 
^ RSM 1507. 07F. ^ 

21. A 'nummary of the results of periodic reviews and progress evalua- 
tions is entered in the IWRP as a record of such reviews and 

.evaluations,- Reference: CFR 1561.39(c)(5); RSM 1507. 07F. 

22. The IWRP miist be foxmaUy reviewed at least annually with the 
client's involvement in the redevelopment of the program, as 
appropriate. As suggested in the RSM; one^tthe scheduled 

! progress evaluations may be expanded to V^^Kf^ ^ formal, annual' 
review.^^ Reference: CFR 1361 .39(c) (11) ; 5Bri507.08, ^ ' 

23. ' • Reference: CFR 1361.39(c)(6); RSM 1507. 07E. 



N'OTE: ' IMPdR^TANT iNpRUCTTIONS 

These instructions on the CRS are provided to assist the re- 
viewer in proceeding to the apjpropriate CRS question(s) at 
the conclusion of Section IV. , • 



24. Once a. client has been de,termined eligible, the law requires 

special procedures if the client is later , determined to b^ in- 
eligible because of a lack of rehabilitation potential (dr the 
inability to achieve a vocational ggal) . CRS ^luestions 24a- 
24d specify such procedures. Reference: CFR 1361.39(e); RSM 
• 1507.10. 

a. Reference: CFR. 1361. 39(e) (1); RSM 1507. lOA. 

b- The rationale for the decision and other pertinent facts 

will be recorded as an amendment to the programs The am^d- 
* ment will include the basis for the ineligibility determina- 
tion and will indicate the client's involvement in the* 
decision. Reference: CFR 1361.39(c)(2); RSM 1507. lOB. 
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c. ■ Reference : 'CFR 1361.39(0) (?) ; RSM 1507. lOB, 

d. A review of the. case with resbect to the ineligibility deci- 
sion is based on' the possibi/ity of changed conditions -and 
new information about the -client's rehabilitation potential. 
Situjrtions in which a periodic review would be precluded 

} are those in which, a client has refused services or a periodic 

; review, the- client is no longer present .in the. state, the 
' , ' client's whereabouts are unknown, or the client's medical 

condition is rapidly progressive or terminal. Reference: 
"CFR 1361.39(c)(3); RSM 1507. IOC. 1549. *» 

25. Reference i RSM 1507. OTH.?. 

I 

a. Reference: CFR 1361. 39(c) (10) ; RSM 1507. 07H. J, 1549.06. 

e. Reference:^ CFR 1361.39(c) (11) ; RSM 1507.071. 

26. The amended IWRP for past-employment services must contain all 
•tihe requirements of an IWRP. Reference CFR 1361.38(©), 1361.39(c). 

Hii); RSM i5or.67i. ^ 



a. • Refei;ence: CFR 1361.39(c) (11) ; RSM 1.507.071 

b. Reference: CFR 1361.38(1); RSM 1543.12 

c. - Reference: RSM 1S43.12 
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Section VI: Delivery of Services Statuses 14, 16, 18,^20, 22 and 32 

The Delivery of Services Section ivequires initial responses t6 all of / 
the available VR services in terms* of their necessi*ty and whether or 'not 
the services Were planned for the client/ Further, an evaluation of 
each of the VR services is required for the service given td prepare 
the client for emplovraent . ' , • 

To evaluate the documentation for the Delivery of Services Section, the 
infonnation collected from the referral date through the termination or 
closure date may be considered . Referral and closure dates are recorded 
in Section I: Case Information. i ^ 



INSTRUCTIONS/GUIDELINES 



( 



The Delivery of Services Section uses a different (Question and answer 
format than other sefctions in the Case Review Schedule*/ Questions 
permits only a YES or NO ijesponse, while Question C permitlj^a YES, NO 
or N/A response. 

The revie\^ is requested to make judgments about each service. The 
Reviewer should respond to Questions A and B for each service (It^ms 
1-14). ^ . ' ^ 

Quj5stiqn B: The reviewer is instructed to respond' YES or NO for each, 
service to show whether or not that service was planned, 
^ Reference CFR 1361.38(a). , * - , 



(Question C; 



Question F: 



Question G: 



The reviewer is instructed to respond YES or NO to show 
whether or not the service was given, or N/A to indicate 
that the question of the service being given is not 'apj^li- 
cable to the status of the case at the time of the review. 
As an example, if a case in Status 10 has vocational train- 
ing services planned, but the case has not progressed to 
the ppint of the service being giv^, the appropriate re- 
sponse then is N/A. Reference: CFljl 1361.38(a) 



The reviewer is asked to make a jud 
consistency of the service with* tf^ 
closure*. 



ent regarding the 
client's employment at 



The reviewer may not necessarily agree with the client's 
employment; however, the reviewer's task is to evaluate the 
consistency of the service in terms of the client's employ- 
ment at closure, not to' evaluate the employment, 

SI 

Reference:** CFR 1361.39(c)(3); RSM 1S49.06B. 

The reviewer is asked to make adjudgment as to whether or 
not "full consideration" was given .to similar benefits that 
are available to help meet the cost of the service. 

Reference: CFR 1361. 4S(b) (1-4) , 1361. 'i8(i); RSM 2015,02, 
2015.03, 2015.04, 2015'05, 2015.06. 
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Exhibit 10 (page 29) 
Services 



1. Evaluation and diagnostic services are those services incidental 
to the determination of eligibility for VR services and the 
nature and" scope of VR services to be provided. Reference: 

CFR 1561.40(a)(1). ^ * , 

2. Counseling and guidance services' include personal adjustment 
counseling to maintain a counseling relationship thrbughout" the 
client's prograiti of service; dyid referral to help the client 
obtain needed services from other ^encies when such ^s^r\'ices 
are not available under the Rehabilitation Act. Reference: 
CFR 1361.40(a)(2). , 

3-4. Physical and mental restoration services are defined as' "those 
services which, are necessary to correct or sul^stantially modify, 
within a reasonable period of time, a physical or mental condi- 
tion which is stable or slowly progressive." These services 
include: i 

a. medical or corrective surgery treatment; 

b. diagnosis and treatment for mental or emotional disorders; 

c. dentisti^y; ^ v * 

d. nursipg services; P 

e. necessary hospitalization and clinic services; * - * 
vf. ^convalescent or nursing home care; ^ 



' drugs and supplies;- 

h. prosthetic, orthotic, or other assistive devices essential 
to obtaining/retaining , employment; 

/ * ' \ 

i. eyeglasses and visual services; 

j. podiatry; \ ^ 

k. ^.physical therapy; 

1. occupational therapy; 

m. speech or hearing therapy; 

n. psychological services; ' 

0. medical or medlfcally related social work services; 
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p. treatment -of acute or chronic medical complications; 



q. special services Ifor^treatin^t of individuals suffering 
from end-stage reftal disease; and '^v 

r. other medical or medically-related rehabilitation services. 

Reference: CFR 1361 . 1 (r) (1-18) ; RSM 1513, 151^.05(3); 1S13.W, 
1513.13. ^ • * • 



a. 



fares, or travel, costs' associated with using public ox pri- 
vate conveyances; ' * • 



b. subsistence or per diem in lieu of 'Subsistence while in 
gravel sratus; ^ \ 

c. attendants or escorts for the severely handicapped and the 
attendants' travel costs; * ^ 

d. relocation and moving expenses; ^and 

e. other r^lited expenses to transportatiorj. 

Reference: CFR 1361. l(cc), 1361.40(a)(6); RSM 1329.05,fl529.06. 
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5. Vocational and other training services include personal and ^ ^ 
vocational adjustment, books, tooj^s and other training matei^.als. 
Reference: CFR 1361.1 (ee) (iv)*", 1361.40(a) (4) - ^ ^ 

6. Maintenance is defined as "Pa>^nts, not exceeding th^ estimated , ^ 
cost of subsistence," which are "provided at any time from the •* 
date of initiation of vocational rehabilitation servic^ through 

the provision of post-employment services." Maintenancs is pro- 
vided tQ cover a client's basic living expenses such as food, 
shelter, clothing, and other subsistence expens^is. Maintenance 
is provided only in order to enable a handicapped* individual to 
derive the full Benefit of oth.er vacational rehabilitation set- ^ 
vices being provided und^er an IWRP. Ma^intenance may be paid 
* ^ring any stage of the rehabilitation 'process, including the 
[ period of follow-up for a specific job Opportunity. Reference: 

CFR 1361. l(ra), X36J.40(a) (5) ; RSM 1527.02. 

State policy: see State Supplement S*ection of the Manual. • ^ 
Reference: RSM 1527.02, 1527.03. 

/ • . 

7. Transportation is defined as "nfecessary travel and related* ex- 
penses, including subsistence during travel' for clients a^d 
their attendants for the^ purpose of providing vocational re- 
habilitation services." This may include relocation and moving ' 
expenses which are necessary for the achievement of a vocational 
rehabilitation objective. Transportation services may include: 
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3. Services to family members are provided when ''necessary to the 

adjustment or rehabilitation" of Che client, Tfiese services 
. >nay include any of the W services available to clien'ts un4er 
^ • CrR 1361.1(ee)(l). 'Reference: CFR 1361.40(a)(7), 1361.1(ee)(l 
, 1361.38(g)- ^ . * 

9. Specialized services for blind, deaf and other severe" <^sa- ^ 
biliiies include: 

.* ^ ' 

. a. reader services, rehabilitation teaching set^ices, and 

' < orientation and mobility services for the blind; 
b. interpreter services for the deaf. ^ 
Reference: CFR 1361 .4a(a) (8,9) . ^ 

10. ' Telecommunications, sensory and other technological aids and 

devices are technological advances, and the resulting devices 
and related services which are app*lied to individual client 
-needs to facilitate' their achievement of rehabilitation goals. 
Reference: CFR 1361 .40(a) (1^) ; RSM 1535.05. ^ 

11. Occupational license is defined as *'any license^, permit, or 
other written authority required by the state, city or other 
governmental unit to be obtained in brder to enter an occupa- 

^ tion or enter a small business.*' This service category also 

includes tools, equipment, initial stocks (including livestock) 
and supplies. The purpose of these services is » tc} increase 
the, client's prospects of successful employment or self- * 
employment following completion of the rehabilitation program. 
Reference:" CFR 1361. l(p); RSM 1545.02, 1545.03A-D-. ^ 

RS^l Chapter 1545.07 specifies case recording requirements'" in • 
relation to^h*e occupational licenses, tools and equipment 
service category. The client's IWRP "should show the need for 
such services and how these se'rvices, in combination with other 
planned serviced, would enable him to engage in the vociitional 
objective of the rehabilitation program." Reference: RSM 
1545.07. \ . ^ ^ 

12. Other goods and seUrices are those "which can reasonably be 
expected to benefit a handicapped individual in terms of employ- 
abilicty." iteference: CFR 1361.40(a) (15) . 

13. ^^lacement services are defined, as "organized and identifiable 
^attempts to establish or improve the linkage of a client and 

a work situation." Vftiile placement in suitable employment is, 
the goal of rehabilitation in' the vocationai;jo:ehabilitation 
programand may be concentrated toward the end o£ the rehab- 
ilitation process, the RSM states that "there should be a sub- 
" stantial amount of planning and attention given to placement 
V early in the case services program." 
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The following are examples of types* of placement services: 

a. collaboration with Employment Service'^, and other organiy- 
^ ^ ■■■ti^iprr invnlvf^d in manpower assistance; 

b. . providing information related to employment during client 

assessment and IWRP development; ' >^ 

c. emp lover contact and job development; 

S 

d. task analysis and job restructuring; ' ■ 

e. study and interpretation of employment trends and economic 
forecasting^ 

^ 

individual and group instruction of clients in job-seeking 
skills', current and potential job openings and development 
of a job-seeking plan; 

g. individual and group counseling of clients on job retention 
. skills; ' - . 

h. personal assistance in conducting job interviews'; ^ 

i. consulting and advising on job adjustment and/or client/ 
employer confli^f^ts; 

j., assiyStance with Affirmative Action programs and projects; 

k. technical assistance and consultation on the placement jb^o- 

' . ' cess; and 
« * 

1, assistance with, and consultation on, removal of architec- 
tural and transportation barrieys to employment. 

Reference: CFR 1361 .40(a) (12) ; RSM 1541.03(2), 1541.04, 
1^54 1.06 (A- L). 

14. ' Post-employment services are defiffed as ''all services provided 
•after clients have been determined to be rehabilitated,** and 
include follow-up, follow-along^ and other post-employment 
services. .The scope of post-employment services **include any 
vocational rehabilitation service or combination of services 
necessary to assist the individual in maintaining employment 
if the service or several services do not entail a complex or 
* comprehensive rehabilitation effort unrelated to the original 
individualiied written rehabilitation program.** Reference: 
CFR 1361-40(a)(13); RSM 1543.03, 1543.05. 
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Section VII: Termii^ation of Cases Statuses 08, 30., and 28. 

The Termination of Cases requires certain procedures to be followed in 
finalizing the outcome ^( the case/ The Termination of Cases Section 
addresses these requirements in relation to cases. closed in Statuses 
OS, 30, and 28. If the case is closed Status 26, proceed to Seafion 
VIII: Timeliness Assessment and Comments. ^ 

To. evaluate the documentation for the Termination of Cases Section, 
the information collected from the referral date through the termina- 
tion or closure date should be considered . Referral and termination 
dates are recorded in CRS Section I : Cas^e Informajtion. 

INSTRUCTIONS/GUIDELINES ^ 



.^TE:. IMPORTANT INSTRUCTIONS 

These instructions are provided to assist the reviewer in" 
proceeding to the appropriate XIRS subsection according to 

the case status at closure. 

\ 

The reviewer is asked to select the appfopriaCte closi^re^' 
status for the ca^e beiag reviewed and respond only^to the 
corresponding subsection. 

The Termination of Cases subsections are: 

Status 08 from 00/02 — Intervening Reasons 

Status 08 from 00/02 — Ineligibility 

Status 08 from 06 Ineligibility 

status 30 or 28 Not Rehabilitated 

Status 26 — Rehabilitated .^t//' , - 



Case Closed Status 08 from ^00/02 — Intervening Reasons 

2(a-c) A case closed in Status 08 from 00/02 for the reasons cited 
in the instructions of this question ^oes not constitute a 
decision of ineligibility. While theXlase Service Report 
R-300 is sufficient to close the case, docuirfijifcation must 
include specific reasons for the closure action. "This means 
that the case file con tains ♦in form at ion on the counselor*s 
attempts to contact the client which were unsuccessful." 
Reference: RSM 1549.048, 1505. 05B, 3005.02(7). 

3. Reference: RSM 1549.03(f), 1505. 05B. 

4. .. Reference: RSM 1549. 03(g) . 



Reference: RSM 1549.03(d). 
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Section VII: Termination of Cases ) 

Case Closed Status 08 from 00/02 -- Ineligibili,ty 

/ ' ■ } 

6: Reference: CFR 1561 .37(c) , 1561 .59 (e) (2) ; RSM '1349'. 03(a) , . 

1505. OSB. ' 
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a. Reference: CFR 1361.37(c); RSM 19pS,0SB. 

b. Reference: CFR 1361.37(c); RSM IS^S.OSB 



J. 



7. A client may be found ineligible for VR services' if the client 
does not have a medically recognized physical or mental dis- 
ability. Although this question addressep a requirement for 
eligibility and is a required question ^r a conformance evalua- 
tion, the reviewer should respond 'N/A if this condition for 
eligibility was met'. Reference:. CFR 1361. 37(c); RSM 1549. 04A,^ 
1505. OSB. 

8. A client may be found ineligible if the medically recognized 
physical or mental disability does not constitute d substantial^ 
handicap to employment for the client. Although this question 
addresses,*a requirement for ^eligibility and is a required question 
for a conformance evaluation, the reviewer should respond N/A 

if this' condition for eligibility was met. Reference: CFR 
• 1361.37(c); RSil lS4a.04A, 1505. 05B. 

9. A client may 'be found ineligible for VR services if it has been 
determined beyond any reasonable doubt that the client cannot 
be expected to benefit in terms of eraployability from VR ser- 
vices. Although this question addresses a requirement for 
eligibility and is a required question for a conformance evalua- 
tion, the reviewer Should respond N/A if this condition for 
eligibility was met. Reference: CFR 1361.37(c); RSM 1549. 04A, 
1S0S.05B. g 

10. The RSM specifies that for clients determined ineligible, the 
case record must include, As a minimum, the information requested 
in points a. through c* of this question. 

a. Reference: RSM 1549.05A(a) 

b. Reference: RSM 1549.05A(b) 

c. Reference: RS^^^ i549.05A(d) / 

11. A clear opportunity for full consultation must be offered unless 
such consultation -is pf^^uded because the client has refused, 
has moved, the client's whereabouts are unknown, or the client's 
medical condition' is rapidly progressive or terminal. Refer- 
ence:, CFR 1361.39(e)(1); RSM 1549.03(b), i505.05B,^ 1507, lOA. 
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E^ibit fO (page 35) - ^ ' 

12. Reference: ^FR 1361. 37(c); RSM'lS49.03(d) , 1505. 05B. 

13. Reference: CFR 1361.37(c); RSM 1549v03(d), 1505. 05B. 

" a. Reference: CFR 1361.37(c); RSM 1505. OSB, 2020.05, 2020.06. 

< 0 

b. Reference: DFR 1361.37(c); RSM 1549.03(e). 

♦ 

c. Reference: CFR>1361 . 39(e) (3) ; RSM 1507. IOC. 

14. Reference: CFR 1361. 38 (in) . 

15. Refereij)be: CFR 1361. "^(c); RSM 1549.03(F) , .1505.058. . 

16. Reference: RSM 1549.03(g). 
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Exhibit 10 (page- 56) 

■ < '■ 

Section VII: Termination o,f Cases 

Case^Closed Status 08 from u6 -- Ineligibility 

17. Reference: 'CFR 1361.37(c), 1361.39(e)(2)'; RSM 1549:03(a), 
1505. OSB. . . ' . . 

a. Referelice: CFR 1361.37(c); RSM ISOS.OSB.. 

b. Reference: CFR 1361.37(c); RSM 15D5.05B. 

18. This question concerns both (1) the- finding that^ the^lient 
is ineligible since it has been determined that the client is 
not expected to benefit in terms of employability from VR ser- 
vices, and (2) the determination at the end of the full 18-month 
limit for the extended evaluation period that the client is not 
eligible. Reference: CFR 1361 .36(e3 (2) ; RSM 1549.05A,B. » 

19. Iflien an interruption of services occurs* during an extended 
evaluation period which precludes "continuation of the IWRP, 

. or an amended' IWRP for extended evaluation, the case should 
be clo^d as ineligible. An inteiruption of services. may 
occur foVa variety* of reasons. Reference: CFR 1361.36(e)(2); 
RSM 1549. OSCr^ 

* 

20. Reference: CFR 1361.39(e)(2); RSM 1549-.03(c), 1507. lOB. 

21. A clear opportunity fot full consultation must be offered unless 
' such consultation is precluded, because the client has refused, 

has moved, the client's whereabouts are unknown, or the client's 
medical condition is rapidly progressive or terminal. Refer- 
ence: CFR 1361.39(e)(1); RSM 1549.03(b), 1505. OSB, 1507. lOA- 

22. IVhen the full participation of the client has been secured, 

in making the ineligibility decision, the client »s ^views shall 
b^ recorded in the IWRP. Reference: CFR .^361. 39(e) (1) . 

23* Reference: RSM 1549.03(d) > 1505. 058. 

24. ' Reference: CFR 1361. 38 (m), 1361.46. 

25 The periodic review, at least annually,' shall affoi^i the clear 

opportunity for full reconsideration of the ineligibility deci- 
sion, except in situations where a jteriodic review would be 
precluded because the client has refused services or a periodic 
review, has moved, the client's whereabouts are unknown, or the 
client's medical condition is rapidly progressive or terminal. 
Reference: CFR 1361.39(e)(3), 1361.37(c), 1361. 38(n); RSM 
1507. IOC. . . 

26. ^Reference: RSM .1549.03(f) , 1505t05B. * 

27. Reference: RSM 1549.03(g). ^ - • 
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Exhibit 10 (page 37) 

Section VII: Termination of Cases 

Case Closed Status 30 and Status 28 — Not -Rehabilitated 



28. . Reference: CFR 1361.-37(c), 1361.39(e)(2); RSM 1549.03(a), 

■„ 1505.05B. ■ ' ' , 

a. Reference: CFR 1361.37(c); RSM 1505. 05B. 

b. Reference: CFR 1361. 37-(c) ; RSM 1505 .05B.. ^ 

29-30. WheiiJie State agency determines that suitable emproyment cannot 
be achieved or that employment resulted without benefit derived 
from VR services, the case should be closed in Status ,28 or Status 
3(y, as appropriate^ Reference: RSM 1549.07.- 

^ t * 

.The criteri-a for determining suitable employment are specified. 

in RSM 1541.09. Suitable employment may include horoemaking if ^ 
the wo^k activities perfopned by the client have benefits derived 
from VR services wfiich "improve the client's ability to function 
(> in these t^ks.'' Reference: RSM 1541.106. 

31. This question requires the reviewer to indicate the primary situ- 
ation which resulted in the case being closed as not rehabilitated. 
For, example, if theyca^ record docueptns that, the client decided 
not to follow tlm>u[^,'^the reviewer would resfqnd YES to a. and N/A 
to b. and c. Reference: "RSM 1549.07. ♦ 

a. If the client decided not to follow through, the case record 
shoiild show that before the case- was closed the State agency • 
attempted to assure that the client: , ^ 

(1) understood the puirpoM of the program and available services; 
and ^ 
' • (2) was informefd that the client may reapply. Reference: RSM 

1549.07. ' ^ . * ' ' 

b. If contact was lost with the client, the case '♦record should show: 

(1) that the counselor attempted to maintain sufficient client 
contact; and 

(2) that additional -^sources of information were used, if appro- 
^ priate, in locatpLng such clients. Reference :^ ^RSM 1549.07. 

c. If there was new infon^ation or complications, the^sise, record 
should show that the State agency reconsidered: \ 

(1) the prospect of the client attaining suitable employment; and 

(2) all available services, including those from other sources, 
before terminating the client. Reference: T?SM 1549.07. 

32. As specified in the' RSM, *nVhen the client can be referred to another 
agency, the referral should involve more than merely advising the , 
client to make application to the o the r< agency," Reference: RSW • 



1549.07. 

33. *^ jieference: RSM 1549. 07(i) 
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34. For a case* closed in- Status 30 from Status 10, the rationale 
for zhe ineligibility determination as an amendment to the IWRP 
is not requried. Reference: CFR 1361.39(e)(2); RSM lS49:03(c), 
1507. lOB. 

35. A clear opportunity for full consultation must be offered unless 
such consultation is precluded because the client has refused, 
has moved, the client's whereabouts are unknown, or the client's 
medical condidtion is rapidly progressive or terminal. Reference;: 
CFR 1361.39(e)(1); RSM 1549.03(b), 1505. 05B, 1507. lOA. 



36. Reference: RSM 1549.03(d), 1505. 05B. 

37. Reference: r5m 1549.03(d), ^OS.OSB. 

a. Reference: CFR 1361.3^(c) (8) , 1361.37(c), RSM 1505. 05B, 
2020.05, 2020.06. 

*b. Reference; CFR 1361.39(e)(3); RSM 1507. IOC. 

-38. Reference: CFR 1361. 38 (m) . - 

39. Reference: CFR 1361.39(e)(3), 1361. 38Cn); RSM 1507. IOC. 

40. Reference: CFR 1361.37(c); RSM 1549.03(f), 1505. dSB. 
4^. Reference: RSM 1549.03(g). 

r 
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Exhibit 10 (page 59) 

Section VII: Termination of Cases ■ , 
Case Closed Status 26 - Rehabilitated 



42. Reference: RSM 1507. 07H. 3. 

a'. Reference:' CFR 1361.39(c) (10) ; RSM 1507.07Hi.3, 1549.06, 

b. Reference: RSM 1507. 07H. 3. 

c. Reference: RSM 1507. 07H. 3. 

d. References RSM 1507. 07H'. 3. 

e. Reference: CFR 1361.39(c) (11) ; RSM 1507.071. 

44. According to* RSM 1549.06C, where facts do not stxpport the appropri- 
ateness of VR services to the ultimate employment of the client, 
the case should be closed as not rehabilitated (Status 28). Appro- 
priateness of VR services is linked ^with the services specified 
in the IWRP. Reference: CFR 1361.41(a)(3); RSM 1549. 06C. 

45. According to the R^, a vocational goal and services to achieve the 
goal are jointly determined through the evaluation process and the 
deveMopm6n< of the individualized written rehabilitation program. 
'Unless some con?) li cations arise, the client completes this total 
program of services...^' Reference: RSM 1549. 06B. 

46. According to the RSM, "unless some coi35>licatiohs arise, the client... 
is placed in employment consistent with the established objective ' 
for which services have prepared the individual." Reference: RSM 
1549. 06B. 

47. Reference: CTR 1361 .41 (a) (4) ; "RSM 1549.06C, 1541 ,09 . 

48. Reference: RSM 1549.03(d). 

49. Reference: RSM 1549.03(g). * • ' ' 

50. Reference: RSM 1549.03(f) . , . 

51. -a-d. The RSM specifies that "in all instances," as a part of the 
process of being determined rehabilitated, the client must be 
informed of eligibility to receive necessary post-employment services 
of the purpdses and any plans for post-employment services, and of the 
responsibility to contact the counselor should situations arise with 
the job suggesting a possible need for post-employment- services . 
Reference: RSM 1541.09(a-c) , 1549. 03(k); 

52. The case record should show a relationship between the services ^ 
rendered and the vocational outcome in that the services were neces- 
sary and had a positive effect on the client's preparation foip, or 
placement in, employment. Reference: RSM 1549. 06B. 
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Exhibit 10 (pag.e 40) 

53. Substantial service is defined as **any vocational rehabilitation 
service provided within a counseling and guidance relationship ^ 
that contributes in any identifiably positive way'' to the client's 
rehabilitation. The substantiality of a service is best determined 
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by its contributiSn^o the client's vocational rehabilitation. 

54. Pertaining to placement services, "substantiality may be assessed 
within a-broad constellation of activities directed toward the 
acquisition of a suitable occupation." The placement services 
specified in 54 a-i represent activities which may be conducted * 
with the client, depending on which activity or combination is 
appropriate for the particular client. Reference: RSM 1541.08 
(a-i) . 

55 . To determine that an occupation is suitable, after a reasonable 
adjustment period it must be confirmed that the conditions speci* 
fied in 55 a-i havejjpeen met, insofar as possible* Reference: 

. CFR 1361.41(a)(4); TBM 1541.09(1-5), 1549.06. 

56. a. Reference: CFR 1361.38k; RSM 1549^.06. 

b. Reference: CFR 1361.38k, RSM 1549.03(h), 1549.06. 

58. The case ofecord should clearly document the justification .for closing 
the case when the suitability criteria, specified in CRS VII ^55 a-i, 
were not met. The justification should also indicate the alternatives, 
which were considered.- Reference: RSM 15^1.09 3^/^. 
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Section VIII: Timeliness Assessment and Connnents 
A. Timeliness 

1-3. Vocational Rehabilitation agencies shall ensure that eligibility 
decisions and client movement through the VR process occur in 
a timely manner appropriate to the needs and capabilities of 
th,e client. Reference: PROCEDURAL STANDARD #11. 

- ^ . . • \ 

Reviewer judgment is called for in responding to the following 

questions. i Three critical phases of case progress are addressed 

here: (a) eligibility determination; (b) development of the 

IWRP; and (c) service delivery through termination. 

Through an analysis of information gathered in this section, 
coupled with data relative to the actual time? cases have re- 
mained in any one of the three phases (from ^ction I; Case 
Information), more objective parameters for a standardized 
case flagging system can be developed. 



NOTE; IMPORTANT INSTRUCTIONS 

These instructions provide the rdviewer with various factors 
to be considered when assessing timeliness during the three 
critical phases described. 

7 
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Section VIII: Timeliness Assessment and Comments 
. B. Comments 



* -reviewer to provide any comments about the 

This section reqt*ests the ^^^^^^f ".gggd in the Case Review Schedule 
case record review which were ^^J^^^f f^jj.i^, feelings about any 
Srecrof^hrJafeT^he^c^eT^^^^^^ documentation of any problems 
. encountered in the review. 
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IV. THE VR PROGRAM STANDARDS * 
REPORTING SYSTEM 

The standards reporting system brings together the varioios sources 
of standards input data so that a particular agency's attainment for a 
specific time period can be compared to its objectives .for the period. In 
addition, the reporting system will provide the program managers with the 
capability to flag and investigate problematic attainment, as we shall \ies-^ 
cribe subsequently. Tq do these two things, the reporting system has been 
designed to: 

• keep track of past performance as well as current expectations; 

• present .the findings in an easy to use, easy to understand way, 
without unwieldy reports, emphasizing graphical' presentations as 
well as plain numbers; and s - 

• make sure that the reporting of results occtirs in a timely 
fashion, so that future performance can be influenced • ^ 

4 

The new data collection requirements for the standards system fiaye been 
described earlier in these Guidance Materials. The procedures and sources 
have been integrated With the Management 'Information System r4IS) being 
developed separately by RSA and Abt Associates. The MIS, while obviously 
serving many additional objectives as well, will be able to produce reports 
providing jfnformation to state agencies that would show performance in terms 
of the standards. and also be usable iii identifying how to improve perfonliance. 
However, even if the MIS unexpectedly were to be^elayed in implcjmentation, 
the standards system is compatible with the kinds of data compilations 
routinely generated even now in many state agencies' internal information 
systems. Thus, the evaluation standards system could be adapted by individual 
state agencies for their use, quite independently of RSA' s development of the 
national MIS. 

Tables 15 „ 16, and 17 illustrate the reports that will be routinely 
generated by the MIS for the Performance Standards. The first set of reports 
(one state's example is seen in Table 15)" shall show achievement on each of 
the standards for a given agency. In addition to showing this year's 
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performance, the table also will show the state's goal for the year, its last 
year's performance, and the previous year's national norm. With this infor- 
mation agencies can see how successful they were in meeting their goals for 
each of the' data elements. They can also compare this year's performance 
with last year's- to see where they have and have not improved. Finally, 
agencies can assess their current performance in relation to recent national 
norms. This type of report gives program managers an overall view of agency 
performance while at the same time pointing out specific strengths and weak- 
nesses, currently and over time. A particular advantage of such reports is 
that their "turnaround" time can be relatively short. That is, program mana- 
gers will receive the reports relatively soon after submitting their data to 
the MIS (allowing, of course, reasonable time for data preparation, input 
and analysis). The short turnaround time is possible bei^ause the reports use 
only the individual agency's data (and a previous year's national norm). 
Computing current year national or regional norms r^lpsiires data submissions 
from all relevant states. Thus, turnaround time for .reports like that shown 
in Table 1 will be a function primarily of the agency^s timeliness in sub- 
mitting data J 

In addition, reports shall be prepared for each data element which will 
display all agencies performance on each particular element. Table 16 shows an 
example for data element lCi)» This year's goal as well as performance in the 
four previous years willxbe presented. Agencies can^use the information to 
compare their perfprmanfce and their goals to other similar agencies. By 
providing data for the four previous years, trends over time can be analyzed. 
Agencies and RSA will be able to determine if performance has steadily improved 
over time or if this year's performance is noticeably different than previous 
^years . , . * ' 

Finally, Table 17 shows an example report of national pefformance for each 
data element for all agencies, and for general, combined, and blind agencies. 
This allows a program-wide view of performance in VR. 

These th'r^e types of reports will be generated routinely for all of the * 
agencies and all of the data elements. In addition, RSA and the agencies will 
have the capability to use the MIS to generate special purpose reports and 
analyses. For example, the basic reports could be run separately fo^r special* 
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populations. These may take the form of statistical reports or of graphic 
displays. f 

J^inally, the MIS wiJl provide access to a large number of supporting 
information items useful in analyzing the interpreting the routine reports- 
These information items feed into the decision-support system, discussed earlier. 
Based on any problems which emerge in thfeagency's standards performance, 
program managers will inspect particular information items keyed to the various 
standards data elements. 

The Statistical Analysis Plan for the MIS, developed by Abt Associates, 
details all of the types of reports and graphics users will be able to generate. 
Exhibits 11-13 illustrate some of the types of displays the MIS can generate. 



■ . ■ c 
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^Abt Associates Inc.; Comprehensive Management Information Systenr for 
the State/Federal VocationaT Rehabilitation Program, Draft Statistical 
Analysis Plan ; Revised October, 1981; RSA Contract #105-78-4012. 
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xxx.x 
xxx.x 
xxx.x 
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Table 16 (ccmpinuedl ^ 

H-^IrlV^ncWr ijp> .-v:i?t-*t.WMANC£ ;i TANDARCiS : STATE COMPARXSON (cont.) 
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XXX*- A 


XXX-X 


A X X - A 


XXX-X 


✓ VV Y 
Aaa - A 




XXX 


XXX-X 


XXX-X 


XXX-X. 


XXX - A 


V V Y V 

AAA . A 


'.IKCBHOnA 


KXX ,X 


XXX-X 


XXX-X 


XXX»X 


V VV V 

AAA • A 


y YY Y 
A A A - A 




aXX-X 


XXX-X 


XXX-X 


XXX,- X 


AXA - A 


Y Y Y V 
AAA - A 


-'ENi^St LVAivj.A 


XXX-X 


XXX-X . 


XXX-X 


AAA - A 


VYV Y 
AAA - A 


V*YY Y 
A A A - A 


-^•JEkTO w;j!CO 


XXX. X 


XXX-X 


XXX-X 


XXX-X 


XXX . X 


V Y Y V 

AAA 4* A 


Hijfih* V SLAN& 


XXX. X 


XXX-X 


XXX. X 


XXX-X 


XXX . X 


V VV V 
AAA .A 




XXX .>! 


XXX-X 


XXX-X 


XXX-X 


XXX. X 


XXX-X 


fV 'J r** r\u I A 


XXX-X 


XXX-X 


XXX-X 


XXX. X 


XXX. X 


xxx.x 




XXX-X 


. XXX-X 


XXX-X 


XXX-X 


XXX. X 


XXX-X 


•=;xA5') 


XXX-X 


XXX-X 


XXX-X 


XXX-X 


XXX. X 


xxx*x 


., >i ■ 


XXX-X 


XXX-X 


XXX-X 


XXX-X 


XXX. X 


XXX-X 




XXX-X 


XXX - X 


XAA - A 


XXX-X 


XXX . X 


XXX-X 




XXX - X 


XXX-X 


XXX-X 


XXX-X 


XXX. X 


XXX-X 




. >';xx-x 


XXX-X 


XXX-X 


XXX-X 


XXX. X 


. XXX-X 


A' c 5 1* .»! K 1 7 X Pi >; A * 


XXX-X 


XXX-X 


XXX-X 


XXX-X 


XXX. X 


XXX-X 




aXX-X 


XXX . A 


XXX-X 


XXX-X 


XXX. X 


XXX-X 




XX X - X 


XXX-X 


xxx^x 


XXX-X 


xxx-.x 


XXX-X 


v^I^Gih* ASLAiviJB 


XXX-X 


XXX -X' 


XXX-X 


XXX-X 


XXX. X 


XXX-X 



/ 
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Table 16 (ccmtinued) 



SJAre COfiPARISON 



0A7A r,L£hh.WTs \x) uiaenxs bervea .per .100,000 Population 



> 

« V f'^'^ 7 ?. C. iJ V 
mELh.wAR?!. 
-'-ORlbA 
IDAHO 

KANSAS 
xENTiJCKY 
riASSACHUiv:. l' i';> • 
il.lCh.: uAN 
nIHNfciSOTA 

oONTAWA 
rvEB'RASKA 

♦V I ~ r*S" t . A R ( J L iv A 
Kin) IV 

•>0»J OAi^OLii WA 
^€XA?> 

•jTAh ' 

v'IRGXNXA 
WA3HAWG10W 



THIS 
fEAR 



aXXw! 
XXX-X 
XXX.X 



THm 


1 QCk{\ 


1 7 / T 


*. • 


AAA N A 


/% A A ■ A 


/\AA . A 


A XX .X 


V y V y 

AAA ■ A 


yyy x 

A A <\ . A 


XXX - X 

A /\ A . /\ 


XXX .X 


yyy y 

AAA ■ A 


yyy y 

A A A . A 


yyy - x 

A A A • A 


xxx.x 


•«'Yy X 

/\A A * A 


xxx.x 


XXX.X ^ 


xxx.x 


xxy X 

A A A , /\ 


xxx.x 


xxx.x 


XXX. 


X X X • X 


xxx.x 


xxx.x 


XXX.X/ 


XXX -X 


xxx.x 


xxx.x 


xxx.x 


XXX • X 




xxx.x 


xxx.x 


xyy 


XXX .X 


xxx.x 


xxx.x 


>^yy y 

A A A • A 


xxx.x 


xxx.x 


xxx.x 


yy y y 

AAA m A 


yyy y 

A A A . /\ 


xxx.x 


xxx.x 


vyv Y 

*\ A A M A 


A /> A • /\ 


xxx.x 


xxx.x 


V x y y 

AAA N A 


yyy y 

AAA . A 


yyy y 

A A A . A 


xxx.x 


XXX •X 


xxx.x 


xxx.x 


xxx.x 


XXX-X^ 


xxx.x 


XXX.X 


xxx;x 


xxx.x . 


xxx.x 


xx>?\x 


xxx.x 


XXX.X 




XXX.X 


xxx.x 


XXX -X 


xxx.x 


xxx.x 


xxx.x 


xxx.x 


"xxx.x 


XXX.X 


xxx.x 


X X A *• X 


XX.X.X 


xxx.x / 


^xx.x' 


XXX, A 


, XXX, X 


XXX.X 


xxx.x 


xxx.x 


XXX.X 


xxx.x 


xxx.x 


XXX «x 


xxx.x 


xxx.x * 


xxx.x 


xxx.x 


XXX .X 


XXX.X 


xxx.x 


\XX.X 


xxx.x 


.xxx.x 


xxx.x 


XXX .x 


xxx.x 


. xxx.x 


xxx.x 


xxx.x 


xxx.x 


xxx.x 


xxx.x 



1977 

XXX.X ■ 
XXX.X 
XXX.X 
XXX.X 
XXX.X 
XXX.X 
XXX.X 
XXX.X 
\XXX.X 

xxx.x 
xxx.x 
xxx.x 
xxx.x 
' xxx.x 
xxx.x 
xxx.x - 
xxx.x 
xxxlx 

XXX .X* 

xx^-.x 

.xxx.x ' 

xxx.x" 

xxx.x 

xxx.x 

xxx.x 

xxx.x 

xxx.x 
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Table 1'7 



HCHIti:V»£nt:Nf aN PtRKORMANCt >SfANi;iARDS 



ALL AGENCIES 

r 



YEhR: 1 98 I. 



COVERAGE 



.00,000 



.Cli'eaxs servea oer 
r6>rceiiT^ seve4^iu aisaoiea 



NATL 
NORn 



/>X.X;t 



2, CuSr-EfFECTIVENESU AND BEtiEFIT 



Exr/enaixures per compel-* 
^^Vve.'.ii t^mvAOuec closure 

,.xpenaiT.art? oer 26 closure 

»xii> Kaxxo o-f '^:r0^aJL /K .oenefits 
i^o Troxai vR cos^s 



liv.* ro"ca.L ne"C Denetiiv trom vk 
services 



'>XX,XaX 
. XX. XX 
XXXX -X 



GEW- 



XXX .X 
X X • X 



bXX,XXX 
sXX,XXX 

XX, XX 

xxxxTa 



BLIND 

XXX. X 
XX ■ x^ 



•iXX.XXX 
XX. XX 
XXXX.X 



COH- 
BI-NEIi 



XXX. X 
XX.Xvf 



^>XX,XXX 

txx.xxx 

XX. XX 

XXXX.X 



ERIC 



3. REhAbiLITA fiUN RATE 

vi;' Percent 26^ closures 

(ii^ Annbai cnanae m num^Der 
of 26 closures 

^« ECuwOriiC 'LNDEi^ti:W):*£NCE 

vi^^ Kercenr 26 ciosur.es witn 
weeKiu earninqs a^/a/DQve 
^ -^eaerai minimum waae 

MJLi> Comoarxson of' ear nxno*» - or 
comtusoXuxve j.u 'ttmT>ioyea 26 
c.iosure'-> i^arnxnq<5 o+ 
employees xn ^tat^e 

5m 'jAJiN-'uL At*, r liVITY 

^i.' Kercenx, 26 closures comriet- 
x^xveiu emp.t.aueci . *^ 

ixi> r'ercenT, c:oMoeT.x^xveXu 

empj.ouedj|f ^26 c losures wx^n 
aour Lu earnxnar> a-:,/iiDove 
•^ederdX mxnxm*xm 'waqe 

ixxx> •'^ercenn noncomDe-'^x'Lxveiw 

empiouec ^6 closures i-»r\owxna| 
improvement in f unc^xonxnq 
• and life staxus 



XX. X7 
XXXX 



XX. XX 



.XX 



XX. X/.'' 
XX. X ♦ 
XX . Xa 
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XX. xz 

XXXX 



XX. XX 



XX. x;/ 



XX . X/« 



XX . X/J^ 



XX. x;.'. 

XXXX ' 



XX. xz : 

XXXX 



aX • Xa^ 



XX. x;* 



XX . X/^ 



XX • X^ 



XX. XZ 

• j 

x'.xx x-.xx x.x^x .i:fi 



XX. X 



XX. XZ 



/XX. XZ 



{ 



222 



,.j:abIsJl2„.(continued) 



, fEAft: 1.98.'. 



i 




De*rdr*?:.- ana ufn^wr Vk 



7. is 



/and. funcT.ioninQ twaliTtu 




■ • XXa A . aX '-^XXXX - Aa 
XXa.X XXX. X 



r'ercen^ ^^6 closures rec^ain- 
ma earninqs at folipw-uo 

Comparison ot 26 closures 
wi^p^ mi;>lic assis^ance as • 
primary ;=iourc-;* ot <^unoort, 
at; cloidri^ ana a^ foi low-up 

<.ii.i >" *^»^rcent, 'noncomoe^iLXve.'.u 
empioued 26 dio^ures 
regaining cxosure 'ok.iil'H at, 
■^oiiow-uD 



XX . A^:' 



XX M XX 



XX .X7 



XX . xr 



XX - XX 



XX. xi 



5LIND 



BINED 



•ixxxx.xx 

XXX. X 

At ^ 



XX v%.^' 



XX. XX 



x>?.x; 



>X)^a)^.XX 
XJCX.X 



XX.XX 



XX. XZ' 



5Hr[Sr.HCTI0N 

^-i; Percenx ciosea Clients _ 
satoistied witn overa-i vK 
experience 

(ii; {^ercert^ ciosea clients 
satistita wl^rx: 

counse/.or 

pny^icuj. re^;^ora^lon 

jOD T,rainD.nq i^ervice^i* 

pxacemenw •^ervice*:> 

MIX/ ' ePcen'r.* osurefi juaaiha 

xn o^Tiaxii.Lnu /t^.-^exr jo.o/ 
Aomemakj^r ^.>xtuat,xon or in 
c u r r ir* n r* *4 r t or m a n c e 



XX'. X/ 



A * \ . r\A> 

XX - XJw' 
XX. X/ 
XX * X/i 



A A -.'4/ 



XX ■ X/k 



xx.x;r 

XX . X/i 
XX . Xa» 



XX . X/.' 



XX. xz* 

XX . Xa 

X A m '/.At 

XX. X/ 



XX. xz 



XX. xz 

XX xz* 

j^X » 
X,X.XZ 



XX. xy . XX. X.?- 



.ERIC 
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Exhibit 13 
National Picture- Sorting Data 
by the Type and Severity of Disability 



Exhibit 7*5 



National Performance On All Closed Cases And On. 
Special Disability Subgroups As A Function Of The 
Severity , Of The Disability 




TYPS OP C13E 



Reprinted from Abt Associat.es* Statistical Analysis Plan (revised 
October 1981), page 7-9. _ 
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APPENDIX 1: 

PROGRAM DATA REQUIREMENTS 
FOR CURRENT VERSION OF BENEFIT-COST MODEL 
DATA ELEMENTS 2(Ui) AND 2(iv) 




* 

■ / 



I. Milftmua Necessary Data 



1 Iten 


i Data Specifications 


Closure Status 


< 


Number of 08 (except closed £rom status 00) closures 


RSA-113: I.A.6.a * I. 8*5. a 


26 * closures 


II.A.4.a 


2S* « . -closures 


XI.A.5.a 


.30 . closures 


II.A.6.a 


Age Distribution 




2* Percentage o^ 26 closures by a^e at referral in each of the 
ten five-year age groups froia 15-19 through 60*64;^ 

1-14 


RSA-300: 

26 closures: Item 4. P. 2 
Age: Item I.£ 


15-19 / 




20-24^ 




25-29 




30-34 




35-39 
40-44 V 




45-49 


« 


50-54, ' --'^ ^ 




55-59 




60-64 ^ , ' 




65* ' J*' ' 
Earnings > 


• 


L 

3. ytrcentagerof 26 closures with paid earnings 

at referral: 4 
at closure: . ^ / 


R5A-300^ 

26 closures: Item 4. P. 2 
Earnings at referral: Item 2.P 
Earnings at Closure: Item 4. J 


4. Average weekly eaminp at referral, of 26 closures with 
eaminp, at referral: 




Average weekly earnings at closure, (»f 26 closures with 
earnings^ at closure: 


* 


Work Status J * 




5. Percentage o£r26 closures classified as homenaJcers 
at referral/ 

at closure/ 

6. Percentage of 26 closures classified as unpaid family 
workers at referral: 


R5A-300: 

26 closures > Item 4. P. 2 
Work status at: 
e referral: Item '2.0 
e closure: Item ^^I • 
(Homemakers * code 5; unpaid family 
workers * code 6) 


Percentage of 26 closures Classified as unpaid family 
workers at closure: 




Time in Process 




,7. Average time in months of 26 closures: 
from referral to Closure: 

from acceptance to closure: - - 


RSA.300:' 

, 26 closures: Item 4. P. 2 ^ ^ 

' Referral date: Item l.C 
Closure date: Item 4. A 
Months in 10-24: Item 4.0.2 
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I. MiniiDUJO Necessary Data (cont^) 



Item " r 


, •» 

Data Specifications * 


Costs 

8. Total progran costs. I.e., expenditures under Section UO, 
I and E (section i20), SSI, and SSOI, durinf the fiscal 
year: 

9. ^otal case, service costs for all clients, under the above 
frograas (except I and E) during the fiscal year 

10. Total case service costs for 26 closures, under the above 
programs (except I and during the fiscal year: 

11. Average life of the case*case service costs for 26 
closures : 


RS^-2: III.C^S (section 110) 

IV. 4 (Trust Fund plus SSI) 

V. C*7 (I ♦ E) 

RSA-2: II.aa.H (110) 

II.D.l.H (Trust Fund) 
II.F.l.H (SSI) 

State accounting systen 

State accounting systen 
or 

RSA-300: 

26 closures ^ Iten 4. P. 2 

Item 4.E.1 (average for alj^ 26s) 



*For non- vocational gain, S-year cohorts for ajj age groups are needed. 



/ 




. Data for Further Sharpening the Calculations 



Item > ' 


Data SDecifications 


Earnings 










1. Percentage of 16 closures with earnings at referral in each 
of the ten five-year age groups from IS- 19 through 60«64. 


r^A-300: 

^6- closures: Item 4 
Earnings at referral 
Age: Item l.E 


.p. 2 - 
; Item 2.P 






2. Percentage of 26 closures with earnings at closure in each 
of thtt ten five-year age groups from lS-1^ through 60-64. 


RSA-300; 

26 closures: Item 4 
Earnings at closure: 
Age: Item l.E 


.P. 2 
Item 4. J 






3. Average weekly^ earnings at referral, of 26 closures with 
earnings at referral, in each of the ten five-year age 
groups fro« IS- 19 through 60-64. 


Same as 1, above. 








• ' . \ 
4. Average weekly earnings at closure, of 26 closures with 

earnings at closure, iu -each of the ten five-year age 

groups, from IS- 19 through 60-64. 


Same as 2, above. 








Data Format -. 










1. Percentage 2« Percentage 3. Earnings 4. Earnings 
with with at Referral at Closure 
Earnings Earnings 
at Referral at Closure * 


- 








IS- 19 " - 
20-24 


• 




J 




30-34 










3S-39 \ ' 










40-44 










4S-49 








- 


S0-S4 










SS-S9 


• 








60-64 . 




















S. Percentage of 26 closures with earnings at^losure who are 
malt: ' 

• «>' 


RSA-300 : 

26 closures : Item 4 
Earnings at closure: 
Sex: Item l.F 


» 

.P. 2 
lt€k 4.J , 




PoHow-Ud 










6. 4 Follow-up data on the percentage of 26 closures with earnings 
some period after closure, i.e., percentage with earjiings: 

, and the period of time After closure the data 


Follow-up survey: 
Question 3 








was collected: 










7. Follow-up data on the earnings of 26 closures some period 
after closure, i.e., average weekly earnings: 


Same as 6, above 








and the period of time after closure the data was 










collected: 
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II. Data ^or Further Sharpeiring the Calculations (cont.)' 



• I tea 



Costs , \ 

3. Percentage of total case service costs for all clients that 
is used to provide maintenance support to clients: 



9. Percentage of program repeaters, 'i.e., current 26 closures 
who have received rehabilitation services in the last three 
/ears and have been previously closed in 26 status: ^ 



Data Specifications 



RSA-2: 

II.B.l.D (sect. IIO) 

n.D.l.O (trust Fundy 

II.F.l.D (SSI) ' 



RSA-300: 

26 closures: Item 4. P. 2 
Previous closure: Item 2. J 



ERIC 
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